Apr 24 01:01:31 devstack cinder-volume[72197]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 01:01:31 devstack cinder-volume[72197]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 01:01:31 devstack cinder-volume[72197]: we strongly recommend against using it for new projects.
Apr 24 01:01:31 devstack cinder-volume[72197]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 01:01:31 devstack cinder-volume[72197]: framework.  For more detail see
Apr 24 01:01:31 devstack cinder-volume[72197]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 01:01:31 devstack cinder-volume[72197]:   import eventlet  # noqa
Apr 24 01:01:32 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:01:32 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:01:32 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:01:33 devstack cinder-volume[72197]: INFO dbcounter [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Registered counter for database cinder
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG oslo_db.sqlalchemy.engines [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG dbcounter [-] [72197] Writer thread running {{(pid=72197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:01:33 devstack cinder-volume[72197]: INFO cinder.rpc [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 01:01:33 devstack cinder-volume[72197]: INFO cinder.rpc [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG oslo_db.sqlalchemy.engines [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:01:33 devstack cinder-volume[72197]: INFO cinder.volume.manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Determined volume DB was empty at startup.
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG cinder.volume.manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72197) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 01:01:33 devstack cinder-volume[72197]: INFO cinder.volume.manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 01:01:33 devstack cinder-volume[72197]: WARNING stevedore.named [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 01:01:33 devstack cinder-volume[72197]: WARNING castellan.key_manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:01:33 devstack cinder-volume[72197]: WARNING cinder.keymgr.conf_key_mgr [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG cinder.volume.drivers.lvm [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72197) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 24 01:01:33 devstack cinder-volume[72197]: DEBUG oslo_concurrency.processutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_concurrency.processutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] CMD "cinder-rtstool verify" returned: 0 in 0.272s {{(pid=72197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_db.sqlalchemy.engines [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:01:34 devstack cinder-volume[72197]: INFO cinder.rpc [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 24 01:01:34 devstack cinder-volume[72197]: INFO cinder.rpc [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 24 01:01:34 devstack cinder-volume[72197]: WARNING stevedore.named [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 01:01:34 devstack cinder-volume[72197]: WARNING castellan.key_manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:01:34 devstack cinder-volume[72197]: INFO cinder.volume.manager [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_db.sqlalchemy.engines [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:01:34 devstack cinder-volume[72197]: INFO oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Starting 1 workers
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Started child 72307 {{(pid=72197) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Full set of CONF: {{(pid=72197) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] ******************************************************************************** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Configuration options gathered from: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] ================================================================================ {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 01:01:34 devstack cinder-volume[72307]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] allow_availability_zone_fallback = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] allow_compression_on_image_upload = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] allowed_direct_url_schemes     = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] api_rate_limit                 = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] auth_strategy                  = keystone {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] az_cache_duration              = 3600 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_availability_zone      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_host                   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_name                   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_stats_polling_interval = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backup_api_class               = cinder.backup.api.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backup_name_template           = backup-%s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backup_use_same_host           = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backup_use_temp_snapshot       = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] chap_password                  = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] chap_username                  =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_internal_tenant_project_id = 475cb72c83784163a2f38982849e7ac9 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_internal_tenant_user_id = 9dc8c061547f4f149efa133e584a3604 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cloned_volume_same_az          = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cluster                        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] compression_format             = gzip {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] compute_api_class              = cinder.compute.nova.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] config_dir                     = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] config_source                  = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] control_exchange               = openstack {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] debug                          = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] default_availability_zone      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] default_group_type             = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] default_volume_type            = lvmdriver-1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] disk_geometry                  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_client_cert             = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_client_cert_key         = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_data_namespace          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_ssl_cert_path           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_ssl_cert_verify         = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] driver_use_ssl                 = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] enable_force_upload            = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] enable_new_services            = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] enable_unsupported_driver      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] enforce_multipath_for_image_xfer = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] filter_function                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_api_insecure            = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_api_servers             = ['http://192.168.122.233/image'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_api_ssl_compression     = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_ca_certificates_file    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_catalog_info            = image:glance:publicURL {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_certfile                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_keyfile                 = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_num_retries             = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance_request_timeout         = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] goodness_function              = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] graceful_shutdown_timeout      = 5 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] group_api_class                = cinder.group.api.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] host                           = devstack {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72307]: INFO cinder.volume.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_compress_on_upload       = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_conversion_address_space_limit = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_conversion_cpu_limit     = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_conversion_disable       = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_upload_use_cinder_backend = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_upload_use_internal_tenant = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_volume_cache_enabled     = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_volume_cache_max_count   = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] image_volume_cache_max_size_gb = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] init_host_max_objects_retrieval = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] instance_format                = [instance: %(uuid)s]  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iscsi_target_flags             =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iscsi_write_cache              = on {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iser_helper                    = tgtadm {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iser_ip_address                = 192.168.122.233 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iser_port                      = 3260 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_color                      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_config_append              = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_dir                        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_file                       = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_options                    = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_rotate_interval            = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_rotate_interval_type       = days {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] log_rotation_type              = none {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] max_age                        = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] max_logfile_count              = 30 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] max_logfile_size_mb            = 200 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] max_over_subscription_ratio    = 20.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] message_reap_interval          = 86400 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] message_ttl                    = 2592000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] migration_create_volume_timeout_secs = 300 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] monkey_patch                   = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] monkey_patch_modules           = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] my_ip                          = 192.168.122.233 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] no_snapshot_gb_quota           = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] num_iser_scan_tries            = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] num_shell_tries                = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] num_volume_device_scan_tries   = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] nvmeof_conn_info_version       = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] nvmet_ns_id                    = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] nvmet_port_id                  = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_max_limit                = 1000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_ext_list          = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_listen_port       = 8776 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_use_ssl           = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] osapi_volume_workers           = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] per_volume_size_limit          = -1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] periodic_fuzzy_delay           = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] periodic_interval              = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] public_endpoint                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] publish_errors                 = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_backup_gigabytes         = 1000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_backups                  = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_gigabytes                = 1000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_groups                   = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_snapshots                = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] quota_volumes                  = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] rate_limit_burst               = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] rate_limit_except_level        = CRITICAL {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] rate_limit_interval            = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] reinit_driver_count            = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] replication_device             = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] report_discard_supported       = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] report_interval                = 120 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] reservation_clean_interval     = 86400 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] reservation_expire             = 86400 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] reserved_image_namespaces      = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] reserved_percentage            = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] rpc_response_timeout           = 120 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] run_external_periodic_tasks    = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] scst_target_driver             = iscsi {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] scst_target_iqn_name           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_down_time              = 720 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] shell_completion               = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] snapshot_name_template         = snapshot-%s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] snapshot_same_host             = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] split_loggers                  = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] state_path                     = /opt/stack/data/cinder {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] storage_availability_zone      = nova {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] storage_protocol               = iSCSI {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] syslog_log_facility            = LOG_USER {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_helper                  = lioadm {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_ip_address              = 192.168.122.233 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_port                    = 3260 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_protocol                = iscsi {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] target_secondary_ip_addresses  = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] trace_flags                    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] transport_url                  = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] until_refresh                  = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_chap_auth                  = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_default_quota_class        = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_journal                    = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_json                       = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_multipath_for_image_xfer   = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_stderr                     = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] use_syslog                     = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] verify_glance_signatures       = enabled {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_api_class               = cinder.volume.api.API {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_backend_name            = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_clear                   = zero {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_clear_ionice            = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_clear_size              = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_copy_bps_limit          = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_dd_blocksize            = 1M {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_name_template           = volume-%s {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_service_inithost_offload = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volume_usage_audit_period      = month {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] zoning_mode                    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_concurrency.disable_process_locking = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.admin_password = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.admin_token = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.admin_user  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_port   = 35357 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_protocol = https {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_section = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_type   = password {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_uri    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.auth_version = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.cache       = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.certfile    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.identity_uri = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.include_service_catalog = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.insecure    = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.interface   = public {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.keyfile     = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_password =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcache_username =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.region_name = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.service_token_roles_required = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.service_type = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.backend                  = dogpile.cache.null {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.backend_argument         = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.backend_expiration_time  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.config_prefix            = cache.oslo {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.debug_cache_backend      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.enable_retry_client      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.enable_socket_keepalive  = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.enabled                  = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.enforce_fips_mode        = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.expiration_time          = 600 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.hashclient_retry_attempts = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_dead_retry      = 300 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_pool_maxsize    = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_sasl_enabled    = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.password                 = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.proxies                  = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.redis_db                 = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.redis_server             = localhost:6379 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.retry_attempts           = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.retry_delay              = 0.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.socket_keepalive_count   = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.socket_keepalive_idle    = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.socket_keepalive_interval = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.socket_timeout           = 1.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.tls_allowed_ciphers      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.tls_cafile               = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.tls_certfile             = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.tls_enabled              = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.tls_keyfile              = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cache.username                 = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] coordination.backend_url       = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.asyncio_connection    = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.asyncio_slave_connection = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.backend               = sqlalchemy {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.connection            = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.connection_debug      = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.connection_parameters =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.connection_recycle_time = 3600 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.connection_trace      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.db_inc_retry_interval = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.db_max_retries        = 20 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.db_max_retry_interval = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.db_retry_interval     = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.max_overflow          = 50 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.max_pool_size         = 5 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.max_retries           = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.mysql_wsrep_sync_wait = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.pool_timeout          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.retry_interval        = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.slave_connection      = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.sqlite_synchronous    = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.synchronous_reader    = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] database.use_db_reconnect      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.connection_string     = messaging:// {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.enabled               = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.es_doc_type           = notification {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.es_scroll_size        = 10000 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.es_scroll_time        = 2m {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.filter_error_trace    = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.hmac_keys             = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.sentinel_service_name = mymaster {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.socket_timeout        = 0.1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.trace_requests        = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler.trace_sqlalchemy      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler_jaeger.process_tags   = {} {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler_jaeger.service_name_prefix = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] profiler_otlp.service_name_prefix = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.enforce_new_defaults = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: WARNING oslo_config.cfg [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.enforce_scope      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.policy_default_rule = default {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.policy_file        = policy.yaml {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.group          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.helper_command = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] privsep_osbrick.user           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.group         = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.helper_command = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] cinder_sys_admin.user          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.auth_section      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.auth_type         = password {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.cafile            = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.certfile          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.collect_timing    = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.insecure          = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.keyfile           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.send_service_user_token = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.split_loggers     = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] service_user.timeout           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.auth_section            = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.auth_type               = password {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.certfile                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.collect_timing          = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.insecure                = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.keyfile                 = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.region_name             = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.split_loggers           = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack sudo[72311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] glance.timeout                 = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.backend_availability_zone = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.chap_password = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.chap_username =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack sudo[72311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.disk_geometry = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_client_cert = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_client_cert_key = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_data_namespace = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.driver_use_ssl = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.extra_capabilities = {} {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.filter_function = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.goodness_function = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iscsi_target_flags =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iscsi_write_cache = on {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iser_helper   = tgtadm {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iser_port     = 3260 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.lvm_share_target = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.lvm_type      = auto {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.num_shell_tries = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.replication_device = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.report_discard_supported = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.reserved_percentage = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_helper = tgtadm {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_port   = 3260 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_protocol = iscsi {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.trace_flags   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.unique_fqdn_network = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.use_chap_auth = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_backend_name = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_clear  = zero {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_clear_ionice = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_clear_size = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_reports.file_event_handler = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_reports.log_dir           = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.backend_availability_zone = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.backend_host       = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.chap_password      = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.chap_username      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.disk_geometry      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_client_cert = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_data_namespace = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.extra_capabilities = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.filter_function    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.goodness_function  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iser_helper        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iser_ip_address    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iser_port          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.iser_target_prefix = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.lvm_share_target   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.lvm_type           = auto {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.num_shell_tries    = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.replication_device = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.report_discard_supported = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.reserved_percentage = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.scst_target_driver = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.storage_protocol   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_helper      = lioadm {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_ip_address  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_port        = 3260 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.trace_flags        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.use_chap_auth      = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_clear       = zero {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_clear_size  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] lvmdriver-1.volumes_dir        = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl      = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_notifications.driver = [] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_notifications.retry = -1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] key_manager.fixed_key          = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.barbican_api_version  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.barbican_endpoint     = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.barbican_endpoint_type = public {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.barbican_region_name  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.cafile                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.certfile              = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.collect_timing        = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.insecure              = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.keyfile               = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.number_of_retries     = 60 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.retry_delay           = 1 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.send_service_user_token = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.split_loggers         = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.timeout               = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.verify_ssl            = True {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican.verify_ssl_path       = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.auth_section = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.auth_type = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.cafile   = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.certfile = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.collect_timing = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.insecure = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.keyfile  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.split_loggers = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] barbican_service_user.timeout  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.approle_role_id          = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.approle_secret_id        = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.kv_mountpoint            = secret {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.kv_path                  = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.kv_version               = 2 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.namespace                = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.root_token_id            = **** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.ssl_ca_crt_file          = None {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.timeout                  = 60.0 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.use_ssl                  = False {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:01:34 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] ******************************************************************************** {{(pid=72197) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 01:01:34 devstack sudo[72311]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:34 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:34 devstack sudo[72329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:34 devstack sudo[72329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:35 devstack sudo[72329]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:35 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.576s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:35 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:01:35 devstack cinder-volume[72307]: INFO cinder.brick.local_dev.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 24 01:01:35 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:35 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:35 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:35 devstack sudo[72586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:35 devstack sudo[72586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:36 devstack sudo[72586]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:36 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.565s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:36 devstack cinder-volume[72307]: DEBUG cinder.brick.local_dev.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72307) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 24 01:01:36 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:36 devstack sudo[72801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:36 devstack sudo[72801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:37 devstack sudo[72801]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.087s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:37 devstack sudo[72976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:37 devstack sudo[72976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:37 devstack sudo[72976]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:37 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:37 devstack sudo[73019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 24 01:01:37 devstack sudo[73019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:38 devstack sudo[73019]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:38 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.725s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:38 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:38 devstack sudo[73052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:38 devstack sudo[73052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:39 devstack sudo[73052]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:39 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:39 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:39 devstack sudo[73060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:39 devstack sudo[73060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:39 devstack sudo[73060]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:39 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:39 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:39 devstack sudo[73063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:39 devstack sudo[73063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:40 devstack sudo[73063]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:40 devstack sudo[73068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:40 devstack sudo[73068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:40 devstack sudo[73068]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:40 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:40 devstack sudo[73078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:40 devstack sudo[73078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:41 devstack sudo[73078]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:41 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:41 devstack cinder-volume[72307]: INFO cinder.volume.drivers.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 24 01:01:41 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:41 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:41 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:41 devstack sudo[73194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:41 devstack sudo[73194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:42 devstack sudo[73194]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:42 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.553s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:42 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:01:42 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:42 devstack sudo[73199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:42 devstack sudo[73199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:42 devstack sudo[73199]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:42 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:42 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:42 devstack sudo[73340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:42 devstack sudo[73340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:43 devstack sudo[73340]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:43 devstack sudo[73343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:43 devstack sudo[73343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:43 devstack sudo[73343]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:43 devstack sudo[73350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:43 devstack sudo[73350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:44 devstack cinder-volume[72197]: DEBUG dbcounter [-] [72197] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:01:44 devstack sudo[73350]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:44 devstack cinder-volume[72307]: INFO cinder.volume.driver [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG cinder.volume.driver [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72307) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG oslo_db.sqlalchemy.engines [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG dbcounter [-] [72307] Writer thread running {{(pid=72307) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG cinder.db.sqlalchemy.api [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Building query based on filter {{(pid=72307) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG cinder.image.image_utils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72307) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 01:01:44 devstack cinder-volume[72307]: INFO cinder.keymgr.migration [None req-dd40be91-3cef-4141-9bab-62f2a67bcfd6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:44 devstack sudo[73355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:44 devstack sudo[73355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:44 devstack sudo[73355]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:44 devstack sudo[73359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:44 devstack sudo[73359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:45 devstack sudo[73359]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:45 devstack sudo[73362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:45 devstack sudo[73362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:45 devstack sudo[73362]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.548s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:45 devstack sudo[73369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:45 devstack sudo[73369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:46 devstack sudo[73369]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG cinder.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Notifying Schedulers of capabilities ... {{(pid=72307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:01:46 devstack cinder-volume[72307]: INFO cinder.volume.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Driver initialization completed successfully.
Apr 24 01:01:46 devstack cinder-volume[72307]: INFO cinder.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Initiating service 2 cleanup
Apr 24 01:01:46 devstack cinder-volume[72307]: INFO cinder.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Service 2 cleanup completed.
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG cinder.service [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Creating RPC server for service cinder-volume {{(pid=72307) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG cinder.service [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72307) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 01:01:46 devstack cinder-volume[72307]: INFO cinder.volume.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:01:46 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:46 devstack sudo[73373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:01:46 devstack sudo[73373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:47 devstack sudo[73373]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:47 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:47 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:47 devstack sudo[73376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:47 devstack sudo[73376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:47 devstack sudo[73376]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:47 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:47 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:47 devstack sudo[73408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:01:47 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:48 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:48 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:48 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:01:48 devstack sudo[73700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:01:48 devstack sudo[73700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:01:48 devstack sudo[73700]: pam_unix(sudo:session): session closed for user root
Apr 24 01:01:48 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:01:48 devstack cinder-volume[72307]: INFO cinder.volume.manager [None req-0927cf2e-55fa-442d-a21c-f21321799783 None None] Driver post RPC initialization completed successfully.
Apr 24 01:01:56 devstack cinder-volume[72307]: DEBUG dbcounter [-] [72307] Writing DB stats cinder:SELECT=3 {{(pid=72307) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:01:58 devstack cinder-volume[72307]: DEBUG dbcounter [-] [72307] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72307) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:02:43 devstack cinder-volume[72307]: DEBUG oslo_service.periodic_task [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:02:43 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:02:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:02:43 devstack sudo[75697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:02:43 devstack sudo[75697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:02:44 devstack sudo[75697]: pam_unix(sudo:session): session closed for user root
Apr 24 01:02:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:02:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:02:44 devstack sudo[75700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:02:44 devstack sudo[75700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:02:44 devstack sudo[75700]: pam_unix(sudo:session): session closed for user root
Apr 24 01:02:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:02:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:02:44 devstack sudo[75706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:02:44 devstack sudo[75706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:02:45 devstack sudo[75706]: pam_unix(sudo:session): session closed for user root
Apr 24 01:02:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:02:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:02:45 devstack sudo[75709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:02:45 devstack sudo[75709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:02:45 devstack sudo[75709]: pam_unix(sudo:session): session closed for user root
Apr 24 01:02:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:02:45 devstack cinder-volume[72307]: DEBUG cinder.manager [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Notifying Schedulers of capabilities ... {{(pid=72307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:03:43 devstack cinder-volume[72307]: DEBUG oslo_service.periodic_task [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:03:43 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:03:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:03:43 devstack sudo[78481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:03:43 devstack sudo[78481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:03:44 devstack sudo[78481]: pam_unix(sudo:session): session closed for user root
Apr 24 01:03:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:03:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:03:44 devstack sudo[78484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:03:44 devstack sudo[78484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:03:44 devstack sudo[78484]: pam_unix(sudo:session): session closed for user root
Apr 24 01:03:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:03:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:03:44 devstack sudo[78487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:03:44 devstack sudo[78487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:03:45 devstack sudo[78487]: pam_unix(sudo:session): session closed for user root
Apr 24 01:03:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:03:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:03:45 devstack sudo[78490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:03:45 devstack sudo[78490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:03:45 devstack sudo[78490]: pam_unix(sudo:session): session closed for user root
Apr 24 01:03:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:03:45 devstack cinder-volume[72307]: DEBUG cinder.manager [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Notifying Schedulers of capabilities ... {{(pid=72307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:03:58 devstack cinder-volume[72307]: DEBUG dbcounter [-] [72307] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72307) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:04:43 devstack cinder-volume[72307]: DEBUG oslo_service.periodic_task [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:04:43 devstack cinder-volume[72307]: DEBUG cinder.volume.drivers.lvm [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Updating volume stats {{(pid=72307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 01:04:43 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:04:43 devstack sudo[80430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 01:04:43 devstack sudo[80430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:04:44 devstack sudo[80430]: pam_unix(sudo:session): session closed for user root
Apr 24 01:04:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:04:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:04:44 devstack sudo[80433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:04:44 devstack sudo[80433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:04:44 devstack sudo[80433]: pam_unix(sudo:session): session closed for user root
Apr 24 01:04:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:04:44 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:04:44 devstack sudo[80459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 01:04:44 devstack sudo[80459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:04:45 devstack sudo[80459]: pam_unix(sudo:session): session closed for user root
Apr 24 01:04:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.530s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:04:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:04:45 devstack sudo[80465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 01:04:45 devstack sudo[80465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:04:45 devstack sudo[80465]: pam_unix(sudo:session): session closed for user root
Apr 24 01:04:45 devstack cinder-volume[72307]: DEBUG oslo_concurrency.processutils [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=72307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:04:45 devstack cinder-volume[72307]: DEBUG cinder.manager [None req-01e6f1b0-d879-46d5-b52f-023eaa1015ac None None] Notifying Schedulers of capabilities ... {{(pid=72307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:05:33 devstack cinder-volume[72197]: INFO oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Caught SIGTERM, stopping children
Apr 24 01:05:33 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Acquiring lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:33 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Acquired lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:33 devstack cinder-volume[72197]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Releasing lock "singleton_lock" {{(pid=72197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:33 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Stop services. {{(pid=72197) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 01:05:33 devstack cinder-volume[72197]: DEBUG oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Killing children. {{(pid=72197) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 01:05:33 devstack cinder-volume[72197]: INFO oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Waiting on 1 children to exit
Apr 24 01:05:36 devstack cinder-volume[72307]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Acquiring lock "singleton_lock" {{(pid=72307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:36 devstack cinder-volume[72307]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Acquired lock "singleton_lock" {{(pid=72307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:36 devstack cinder-volume[72307]: DEBUG oslo_concurrency.lockutils [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Releasing lock "singleton_lock" {{(pid=72307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:36 devstack cinder-volume[72307]: WARNING amqp [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 01:05:36 devstack cinder-volume[72307]: WARNING amqp [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 01:05:36 devstack cinder-volume[72197]: INFO oslo_service.backend._eventlet.service [None req-02926ff5-1f39-401f-91c7-ffad3ebc13bb None None] Child 72307 exited with status 0
Apr 24 01:05:36 devstack cinder-volume[81331]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 01:05:36 devstack cinder-volume[81331]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 01:05:36 devstack cinder-volume[81331]: we strongly recommend against using it for new projects.
Apr 24 01:05:36 devstack cinder-volume[81331]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 01:05:36 devstack cinder-volume[81331]: framework.  For more detail see
Apr 24 01:05:36 devstack cinder-volume[81331]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 01:05:36 devstack cinder-volume[81331]:   import eventlet  # noqa
Apr 24 01:05:39 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:39 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:39 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:39 devstack cinder-volume[81331]: INFO dbcounter [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Registered counter for database cinder
Apr 24 01:05:39 devstack cinder-volume[81331]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG dbcounter [-] [81331] Writer thread running {{(pid=81331) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO cinder.rpc [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO cinder.rpc [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO cinder.volume.manager [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Determined volume DB was empty at startup.
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG cinder.volume.manager [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81331) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO cinder.volume.manager [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 01:05:40 devstack cinder-volume[81331]: WARNING stevedore.named [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 01:05:40 devstack cinder-volume[81331]: WARNING castellan.key_manager [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:05:40 devstack cinder-volume[81331]: WARNING cinder.keymgr.conf_key_mgr [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO cinder.volume.manager [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:40 devstack cinder-volume[81331]: INFO oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Starting 1 workers
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Started child 81449 {{(pid=81331) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Full set of CONF: {{(pid=81331) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] ******************************************************************************** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Configuration options gathered from: {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] ================================================================================ {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] allow_availability_zone_fallback = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] allow_compression_on_image_upload = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] allowed_direct_url_schemes     = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] api_rate_limit                 = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] auth_strategy                  = keystone {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_availability_zone      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_host                   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_name                   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_stats_polling_interval = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backup_api_class               = cinder.backup.api.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backup_name_template           = backup-%s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backup_use_same_host           = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backup_use_temp_snapshot       = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] chap_password                  = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] chap_username                  =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_internal_tenant_project_id = 475cb72c83784163a2f38982849e7ac9 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_internal_tenant_user_id = 9dc8c061547f4f149efa133e584a3604 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cluster                        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] compression_format             = gzip {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] compute_api_class              = cinder.compute.nova.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] config_dir                     = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] config_source                  = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] control_exchange               = openstack {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] debug                          = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81449]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] default_availability_zone      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] default_group_type             = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] default_volume_type            = QuobyteHD {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] disk_geometry                  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_client_cert             = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_client_cert_key         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_data_namespace          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_ssl_cert_path           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_ssl_cert_verify         = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] driver_use_ssl                 = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] enable_new_services            = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] enable_unsupported_driver      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] enabled_backends               = ['QuobyteHD'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] enforce_multipath_for_image_xfer = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] filter_function                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_api_insecure            = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_api_servers             = ['http://192.168.122.233/image'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_api_ssl_compression     = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_ca_certificates_file    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_catalog_info            = image:glance:publicURL {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_certfile                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_keyfile                 = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_num_retries             = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance_request_timeout         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] goodness_function              = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] graceful_shutdown_timeout      = 5 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] group_api_class                = cinder.group.api.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] host                           = devstack {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_compress_on_upload       = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_conversion_address_space_limit = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_conversion_cpu_limit     = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_conversion_disable       = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_upload_use_cinder_backend = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_upload_use_internal_tenant = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_volume_cache_enabled     = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_volume_cache_max_count   = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] image_volume_cache_max_size_gb = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] init_host_max_objects_retrieval = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] instance_format                = [instance: %(uuid)s]  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iscsi_target_flags             =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iscsi_write_cache              = on {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iser_helper                    = tgtadm {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iser_ip_address                = 192.168.122.233 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iser_port                      = 3260 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_color                      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_config_append              = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_dir                        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_file                       = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_options                    = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_rotate_interval            = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_rotate_interval_type       = days {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] log_rotation_type              = none {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] max_age                        = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] max_logfile_count              = 30 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] max_logfile_size_mb            = 200 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] max_over_subscription_ratio    = 20.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] message_reap_interval          = 86400 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] message_ttl                    = 2592000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] migration_create_volume_timeout_secs = 300 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] monkey_patch                   = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] monkey_patch_modules           = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] my_ip                          = 192.168.122.233 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] no_snapshot_gb_quota           = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] num_iser_scan_tries            = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] num_shell_tries                = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] num_volume_device_scan_tries   = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] nvmeof_conn_info_version       = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] nvmet_ns_id                    = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] nvmet_port_id                  = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_max_limit                = 1000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_ext_list          = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_listen_port       = 8776 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_use_ssl           = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] osapi_volume_workers           = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] per_volume_size_limit          = -1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] periodic_fuzzy_delay           = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] periodic_interval              = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] public_endpoint                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] publish_errors                 = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_backup_gigabytes         = 1000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_backups                  = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_gigabytes                = 1000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_groups                   = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_snapshots                = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] quota_volumes                  = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] rate_limit_burst               = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] rate_limit_except_level        = CRITICAL {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] rate_limit_interval            = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] reinit_driver_count            = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] replication_device             = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] report_discard_supported       = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] report_interval                = 120 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] reservation_clean_interval     = 86400 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] reservation_expire             = 86400 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] reserved_image_namespaces      = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] reserved_percentage            = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] rpc_response_timeout           = 120 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] run_external_periodic_tasks    = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] scst_target_driver             = iscsi {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] scst_target_iqn_name           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_down_time              = 720 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] shell_completion               = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] snapshot_name_template         = snapshot-%s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] split_loggers                  = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] state_path                     = /opt/stack/data/cinder {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] storage_availability_zone      = nova {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] storage_protocol               = iSCSI {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] syslog_log_facility            = LOG_USER {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_helper                  = lioadm {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_ip_address              = 192.168.122.233 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_port                    = 3260 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_protocol                = iscsi {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] target_secondary_ip_addresses  = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] trace_flags                    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] transport_url                  = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] until_refresh                  = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_chap_auth                  = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_default_quota_class        = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_journal                    = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_json                       = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_multipath_for_image_xfer   = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_stderr                     = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] use_syslog                     = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] verify_glance_signatures       = enabled {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_api_class               = cinder.volume.api.API {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_backend_name            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_clear                   = zero {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_clear_ionice            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_clear_size              = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_copy_bps_limit          = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_dd_blocksize            = 1M {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_name_template           = volume-%s {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_service_inithost_offload = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volume_usage_audit_period      = month {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] zoning_mode                    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_concurrency.disable_process_locking = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.admin_password = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.admin_token = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.admin_user  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_port   = 35357 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_protocol = https {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_section = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_type   = password {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_uri    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.auth_version = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.cache       = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.certfile    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.identity_uri = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.include_service_catalog = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.insecure    = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.interface   = public {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.keyfile     = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_password =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcache_username =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.region_name = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.service_type = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.backend                  = dogpile.cache.null {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.backend_argument         = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.backend_expiration_time  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.config_prefix            = cache.oslo {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.debug_cache_backend      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.enable_retry_client      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.enable_socket_keepalive  = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.enabled                  = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.enforce_fips_mode        = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.expiration_time          = 600 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.hashclient_retry_attempts = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_dead_retry      = 300 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_pool_maxsize    = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_sasl_enabled    = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.password                 = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.proxies                  = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.redis_db                 = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.redis_server             = localhost:6379 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.retry_attempts           = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.retry_delay              = 0.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.socket_keepalive_count   = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.socket_keepalive_idle    = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.socket_keepalive_interval = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.socket_timeout           = 1.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.tls_allowed_ciphers      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.tls_cafile               = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.tls_certfile             = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.tls_enabled              = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.tls_keyfile              = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cache.username                 = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] coordination.backend_url       = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.asyncio_connection    = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.asyncio_slave_connection = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.backend               = sqlalchemy {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.connection            = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.connection_debug      = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.connection_parameters =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.connection_recycle_time = 3600 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.connection_trace      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.db_inc_retry_interval = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81449]: INFO cinder.volume.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.db_max_retries        = 20 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.remotefs [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81449) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.db_max_retry_interval = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.db_retry_interval     = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.max_overflow          = 50 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.max_pool_size         = 5 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.max_retries           = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.mysql_wsrep_sync_wait = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.pool_timeout          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.retry_interval        = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.slave_connection      = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.sqlite_synchronous    = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.synchronous_reader    = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] database.use_db_reconnect      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.connection_string     = messaging:// {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.enabled               = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.es_doc_type           = notification {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.es_scroll_size        = 10000 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.es_scroll_time        = 2m {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.filter_error_trace    = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.hmac_keys             = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.sentinel_service_name = mymaster {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.socket_timeout        = 0.1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.trace_requests        = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler.trace_sqlalchemy      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler_jaeger.process_tags   = {} {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler_jaeger.service_name_prefix = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] profiler_otlp.service_name_prefix = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.enforce_new_defaults = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: WARNING oslo_config.cfg [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.enforce_scope      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.policy_default_rule = default {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.policy_file        = policy.yaml {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.group          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.helper_command = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] privsep_osbrick.user           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.group         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.helper_command = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] cinder_sys_admin.user          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.auth_section      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.auth_type         = password {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.cafile            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.certfile          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.collect_timing    = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.insecure          = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.keyfile           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.send_service_user_token = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.split_loggers     = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] service_user.timeout           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.auth_section            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.auth_type               = password {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.certfile                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.collect_timing          = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.insecure                = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.keyfile                 = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.region_name             = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.split_loggers           = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] glance.timeout                 = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.backend_availability_zone = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.chap_password = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.chap_username =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.disk_geometry = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_client_cert = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_client_cert_key = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_data_namespace = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.driver_use_ssl = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.extra_capabilities = {} {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.filter_function = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.goodness_function = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iscsi_target_flags =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iscsi_write_cache = on {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iser_helper   = tgtadm {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iser_port     = 3260 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_host      =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_login     = admin {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_mount_options = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_password  = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_private_key =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_share_path =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.num_shell_tries = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.quobyte_volume_url = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.replication_device = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.report_discard_supported = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.reserved_percentage = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_helper = tgtadm {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_port   = 3260 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_protocol = iscsi {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.trace_flags   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.unique_fqdn_network = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.use_chap_auth = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_backend_name = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_clear  = zero {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_clear_ionice = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_clear_size = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_reports.file_event_handler = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_reports.log_dir           = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.backend_availability_zone = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.backend_host         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.chap_password        = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.chap_username        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.chiscsi_conf         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.disk_geometry        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_client_cert   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_data_namespace = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.driver_use_ssl       = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.extra_capabilities   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.filter_function      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.goodness_function    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iser_helper          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iser_ip_address      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iser_port            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.iser_target_prefix   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_host             = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_login            = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_mount_options    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_password         = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_private_key      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_share_path       = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_ssh_port         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.num_shell_tries      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.nvmet_port_id        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.replication_device   = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.report_discard_supported = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.reserved_percentage  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.scst_target_driver   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.storage_protocol     = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_helper        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_ip_address    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_port          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_prefix        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_protocol      = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.trace_flags          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.use_chap_auth        = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_clear         = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_clear_size    = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] QuobyteHD.volumes_dir          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl      = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_notifications.driver = [] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_notifications.retry = -1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] key_manager.fixed_key          = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.barbican_api_version  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.barbican_endpoint     = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.barbican_endpoint_type = public {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.barbican_region_name  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.cafile                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.certfile              = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.collect_timing        = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.insecure              = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.keyfile               = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.number_of_retries     = 60 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.retry_delay           = 1 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.send_service_user_token = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.split_loggers         = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.timeout               = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.verify_ssl            = True {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican.verify_ssl_path       = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.auth_section = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.auth_type = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.cafile   = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.certfile = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.collect_timing = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.insecure = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.keyfile  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.split_loggers = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] barbican_service_user.timeout  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.approle_role_id          = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.approle_secret_id        = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.kv_mountpoint            = secret {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.kv_path                  = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.kv_version               = 2 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.namespace                = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.root_token_id            = **** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.ssl_ca_crt_file          = None {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.timeout                  = 60.0 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.use_ssl                  = False {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:40 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] ******************************************************************************** {{(pid=81331) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81449) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 01:05:40 devstack cinder-volume[81449]: WARNING cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 01:05:40 devstack cinder-volume[81449]: WARNING cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Running cmd (subprocess): mount.quobyte {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:40 devstack quobyte-client[81450]: Reading configuration file: /etc/quobyte/client.cfg
Apr 24 01:05:40 devstack quobyte-client[81450]: Invalid parameters found, error: missing mount point.
Apr 24 01:05:40 devstack quobyte-client[81450]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 24 01:05:40 devstack quobyte-client[81450]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:40 devstack cinder-volume[81449]: INFO cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 ...
Apr 24 01:05:40 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 -c /etc/quobyte/client-cinder.cfg {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:40 devstack sudo[81451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 -c /etc/quobyte/client-cinder.cfg
Apr 24 01:05:40 devstack sudo[81451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:41 devstack sudo[81451]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.607s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:41 devstack cinder-volume[81449]: INFO cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 succeeded
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.619s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:41 devstack sudo[81520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:41 devstack sudo[81520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:41 devstack sudo[81520]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.477s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:41 devstack cinder-volume[81449]: INFO cinder.volume.driver [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.volume.driver [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6606712341309, 'free_capacity_gb': 1775.6606712341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.db.sqlalchemy.api [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Building query based on filter {{(pid=81449) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.image.image_utils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 01:05:41 devstack cinder-volume[81449]: INFO cinder.keymgr.migration [None req-2c2310be-7f27-419f-b252-dec393dc27e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:41 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:41 devstack sudo[81524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:41 devstack sudo[81524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:42 devstack sudo[81524]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.495s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG cinder.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Notifying Schedulers of capabilities ... {{(pid=81449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:05:42 devstack cinder-volume[81449]: INFO cinder.volume.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Driver initialization completed successfully.
Apr 24 01:05:42 devstack cinder-volume[81449]: INFO cinder.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Initiating service 3 cleanup
Apr 24 01:05:42 devstack cinder-volume[81449]: INFO cinder.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Service 3 cleanup completed.
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG cinder.service [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Creating RPC server for service cinder-volume {{(pid=81449) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG cinder.service [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81449) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 01:05:42 devstack cinder-volume[81449]: INFO cinder.volume.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:42 devstack sudo[81532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:42 devstack sudo[81532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:42 devstack sudo[81532]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:42 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.547s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:43 devstack cinder-volume[81449]: INFO cinder.volume.manager [None req-471eadfb-6f45-4fde-a096-7b8a0276274c None None] Driver post RPC initialization completed successfully.
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG cinder.volume.drivers.quobyte [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:46 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:46 devstack sudo[81595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:46 devstack sudo[81595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:47 devstack sudo[81595]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:47 devstack cinder-volume[81449]: DEBUG oslo_concurrency.processutils [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.490s {{(pid=81449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:47 devstack cinder-volume[81449]: DEBUG cinder.manager [None req-277e1f72-711f-49a5-8ec3-28e9f10bd9a3 None None] Notifying Schedulers of capabilities ... {{(pid=81449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:05:48 devstack cinder-volume[81331]: INFO oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Caught SIGTERM, stopping children
Apr 24 01:05:48 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Acquiring lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:48 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Acquired lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:48 devstack cinder-volume[81331]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Releasing lock "singleton_lock" {{(pid=81331) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:48 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Stop services. {{(pid=81331) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 01:05:48 devstack cinder-volume[81331]: DEBUG oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Killing children. {{(pid=81331) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 01:05:48 devstack cinder-volume[81331]: INFO oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Waiting on 1 children to exit
Apr 24 01:05:50 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Acquiring lock "singleton_lock" {{(pid=81449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:50 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Acquired lock "singleton_lock" {{(pid=81449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:50 devstack cinder-volume[81449]: DEBUG oslo_concurrency.lockutils [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Releasing lock "singleton_lock" {{(pid=81449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:50 devstack cinder-volume[81449]: WARNING amqp [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 01:05:50 devstack cinder-volume[81449]: WARNING amqp [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 01:05:50 devstack cinder-volume[81331]: INFO oslo_service.backend._eventlet.service [None req-d7e183e9-5e4b-42dc-98d2-82dd6601911f None None] Child 81449 exited with status 0
Apr 24 01:05:51 devstack cinder-volume[81676]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 01:05:51 devstack cinder-volume[81676]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 01:05:51 devstack cinder-volume[81676]: we strongly recommend against using it for new projects.
Apr 24 01:05:51 devstack cinder-volume[81676]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 01:05:51 devstack cinder-volume[81676]: framework.  For more detail see
Apr 24 01:05:51 devstack cinder-volume[81676]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 01:05:51 devstack cinder-volume[81676]:   import eventlet  # noqa
Apr 24 01:05:53 devstack cinder-volume[81676]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 01:05:53 devstack cinder-volume[81676]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 01:05:53 devstack cinder-volume[81676]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 01:05:53 devstack cinder-volume[81676]: INFO dbcounter [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Registered counter for database cinder
Apr 24 01:05:53 devstack cinder-volume[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG dbcounter [-] [81676] Writer thread running {{(pid=81676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:05:54 devstack cinder-volume[81676]: INFO cinder.rpc [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 01:05:54 devstack cinder-volume[81676]: INFO cinder.rpc [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:54 devstack cinder-volume[81676]: INFO cinder.volume.manager [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Determined volume DB was empty at startup.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG cinder.volume.manager [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81676) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 01:05:54 devstack cinder-volume[81676]: WARNING stevedore.named [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 01:05:54 devstack cinder-volume[81676]: WARNING castellan.key_manager [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:05:54 devstack cinder-volume[81676]: WARNING cinder.keymgr.conf_key_mgr [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 01:05:54 devstack cinder-volume[81676]: INFO cinder.volume.manager [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:54 devstack cinder-volume[81676]: INFO oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Starting 1 workers
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Started child 81902 {{(pid=81676) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Full set of CONF: {{(pid=81676) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] ******************************************************************************** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Configuration options gathered from: {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] ================================================================================ {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] allow_availability_zone_fallback = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] allow_compression_on_image_upload = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] allowed_direct_url_schemes     = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] api_rate_limit                 = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] auth_strategy                  = keystone {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_availability_zone      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_host                   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_name                   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_stats_polling_interval = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backup_api_class               = cinder.backup.api.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backup_name_template           = backup-%s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backup_use_same_host           = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backup_use_temp_snapshot       = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] chap_password                  = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] chap_username                  =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_internal_tenant_project_id = 475cb72c83784163a2f38982849e7ac9 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_internal_tenant_user_id = 9dc8c061547f4f149efa133e584a3604 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cluster                        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] compression_format             = gzip {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] compute_api_class              = cinder.compute.nova.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] config_dir                     = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] config_source                  = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] control_exchange               = openstack {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] debug                          = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] default_availability_zone      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] default_group_type             = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] default_volume_type            = QuobyteHD {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] disk_geometry                  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_client_cert             = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_client_cert_key         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_data_namespace          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_ssl_cert_path           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_ssl_cert_verify         = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81902]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] driver_use_ssl                 = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] enable_new_services            = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] enable_unsupported_driver      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] enabled_backends               = ['QuobyteHD'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] enforce_multipath_for_image_xfer = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] filter_function                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_api_insecure            = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_api_servers             = ['http://192.168.122.233/image'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_api_ssl_compression     = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_ca_certificates_file    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_catalog_info            = image:glance:publicURL {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_certfile                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_keyfile                 = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_num_retries             = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance_request_timeout         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] goodness_function              = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] graceful_shutdown_timeout      = 5 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] group_api_class                = cinder.group.api.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] host                           = devstack {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_compress_on_upload       = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_conversion_address_space_limit = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_conversion_cpu_limit     = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_conversion_disable       = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_upload_use_cinder_backend = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_upload_use_internal_tenant = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_volume_cache_enabled     = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_volume_cache_max_count   = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] image_volume_cache_max_size_gb = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] init_host_max_objects_retrieval = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] instance_format                = [instance: %(uuid)s]  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iscsi_target_flags             =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iscsi_write_cache              = on {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iser_helper                    = tgtadm {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iser_ip_address                = 192.168.122.233 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iser_port                      = 3260 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_color                      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_config_append              = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_dir                        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_file                       = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_options                    = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_rotate_interval            = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_rotate_interval_type       = days {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] log_rotation_type              = none {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] max_age                        = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] max_logfile_count              = 30 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] max_logfile_size_mb            = 200 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] max_over_subscription_ratio    = 20.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] message_reap_interval          = 86400 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] message_ttl                    = 2592000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] migration_create_volume_timeout_secs = 300 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] monkey_patch                   = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] monkey_patch_modules           = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] my_ip                          = 192.168.122.233 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] no_snapshot_gb_quota           = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] num_iser_scan_tries            = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] num_shell_tries                = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] num_volume_device_scan_tries   = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] nvmeof_conn_info_version       = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] nvmet_ns_id                    = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] nvmet_port_id                  = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_max_limit                = 1000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_ext_list          = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_listen_port       = 8776 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_use_ssl           = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] osapi_volume_workers           = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] per_volume_size_limit          = -1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] periodic_fuzzy_delay           = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] periodic_interval              = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] public_endpoint                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] publish_errors                 = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_backup_gigabytes         = 1000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_backups                  = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_gigabytes                = 1000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_groups                   = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_snapshots                = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] quota_volumes                  = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] rate_limit_burst               = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] rate_limit_except_level        = CRITICAL {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] rate_limit_interval            = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] reinit_driver_count            = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] replication_device             = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] report_discard_supported       = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] report_interval                = 120 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] reservation_clean_interval     = 86400 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] reservation_expire             = 86400 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] reserved_image_namespaces      = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] reserved_percentage            = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] rpc_response_timeout           = 120 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] run_external_periodic_tasks    = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] scst_target_driver             = iscsi {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] scst_target_iqn_name           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_down_time              = 720 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] shell_completion               = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] snapshot_name_template         = snapshot-%s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] split_loggers                  = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] state_path                     = /opt/stack/data/cinder {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] storage_availability_zone      = nova {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] storage_protocol               = iSCSI {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] syslog_log_facility            = LOG_USER {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_helper                  = lioadm {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_ip_address              = 192.168.122.233 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_port                    = 3260 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_protocol                = iscsi {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81902) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] target_secondary_ip_addresses  = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] trace_flags                    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] transport_url                  = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] until_refresh                  = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_chap_auth                  = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_default_quota_class        = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_journal                    = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_json                       = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_multipath_for_image_xfer   = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_stderr                     = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] use_syslog                     = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] verify_glance_signatures       = enabled {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_api_class               = cinder.volume.api.API {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_backend_name            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_clear                   = zero {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_clear_ionice            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_clear_size              = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_copy_bps_limit          = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_dd_blocksize            = 1M {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_name_template           = volume-%s {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_service_inithost_offload = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volume_usage_audit_period      = month {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] zoning_mode                    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_concurrency.disable_process_locking = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.admin_password = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.admin_token = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.admin_user  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_port   = 35357 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_protocol = https {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_section = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_type   = password {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_uri    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.auth_version = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.cache       = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.certfile    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.delay_auth_decision = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.http_connect_timeout = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.identity_uri = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.include_service_catalog = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.insecure    = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.interface   = public {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.keyfile     = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_password =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcache_username =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.region_name = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.service_token_roles_required = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack quobyte-client[81924]: Reading configuration file: /etc/quobyte/client.cfg
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.service_type = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.token_cache_time = 300 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.backend                  = dogpile.cache.null {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.backend_argument         = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.backend_expiration_time  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack quobyte-client[81924]: Invalid parameters found, error: missing mount point.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.config_prefix            = cache.oslo {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.debug_cache_backend      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.enable_retry_client      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.enable_socket_keepalive  = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.enabled                  = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.enforce_fips_mode        = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.expiration_time          = 600 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack quobyte-client[81924]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.hashclient_retry_attempts = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_dead_retry      = 300 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_pool_maxsize    = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack quobyte-client[81924]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_sasl_enabled    = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.password                 = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.proxies                  = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.redis_db                 = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.redis_sentinel_service_name = mymaster {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.redis_server             = localhost:6379 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.retry_attempts           = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.retry_delay              = 0.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.socket_keepalive_count   = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.socket_keepalive_idle    = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.socket_keepalive_interval = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.socket_timeout           = 1.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.tls_allowed_ciphers      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.tls_cafile               = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.tls_certfile             = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.tls_enabled              = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.tls_keyfile              = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cache.username                 = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack sudo[81928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] coordination.backend_url       = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.asyncio_connection    = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.asyncio_slave_connection = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.backend               = sqlalchemy {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.connection            = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.connection_debug      = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.connection_parameters =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack sudo[81928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.connection_recycle_time = 3600 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.connection_trace      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.db_inc_retry_interval = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.db_max_retries        = 20 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.db_max_retry_interval = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.db_retry_interval     = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.max_overflow          = 50 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.max_pool_size         = 5 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.max_retries           = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.mysql_wsrep_sync_wait = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.pool_timeout          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.retry_interval        = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.slave_connection      = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.sqlite_synchronous    = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.synchronous_reader    = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] database.use_db_reconnect      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.connection_string     = messaging:// {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.enabled               = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.es_doc_type           = notification {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.es_scroll_size        = 10000 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.es_scroll_time        = 2m {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.filter_error_trace    = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.hmac_keys             = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.sentinel_service_name = mymaster {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.socket_timeout        = 0.1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.trace_requests        = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler.trace_sqlalchemy      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler_jaeger.process_tags   = {} {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler_jaeger.service_name_prefix = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] profiler_otlp.service_name_prefix = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.enforce_new_defaults = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: WARNING oslo_config.cfg [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.enforce_scope      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.policy_default_rule = default {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.policy_file        = policy.yaml {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81902) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 01:05:54 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.group          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Running cmd (subprocess): mount.quobyte {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.helper_command = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] privsep_osbrick.user           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.group         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.helper_command = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] cinder_sys_admin.user          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.auth_section      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.auth_type         = password {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.cafile            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.certfile          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.collect_timing    = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.insecure          = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.keyfile           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.send_service_user_token = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.split_loggers     = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] service_user.timeout           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.auth_section            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.auth_type               = password {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.certfile                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.collect_timing          = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.insecure                = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.keyfile                 = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.region_name             = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.split_loggers           = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] glance.timeout                 = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.backend_availability_zone = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.chap_password = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.chap_username =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.disk_geometry = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_client_cert = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_client_cert_key = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_data_namespace = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.driver_use_ssl = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.enable_unsupported_driver = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.extra_capabilities = {} {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.filter_function = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.goodness_function = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iscsi_target_flags =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iscsi_write_cache = on {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iser_helper   = tgtadm {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iser_port     = 3260 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_host      =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_login     = admin {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_mount_options = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_password  = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_private_key =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_share_path =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.num_shell_tries = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.nvmet_port_id = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_client_cfg = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.quobyte_volume_url = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.replication_device = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.report_discard_supported = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.reserved_percentage = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.scst_target_driver = iscsi {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.scst_target_iqn_name = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.storage_protocol = iSCSI {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_helper = tgtadm {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:54 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_port   = 3260 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_protocol = iscsi {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.trace_flags   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.unique_fqdn_network = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.use_chap_auth = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_backend_name = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_clear  = zero {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_clear_ionice = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_clear_size = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_reports.file_event_handler = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_reports.log_dir           = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.backend_availability_zone = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.backend_host         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.chap_password        = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.chap_username        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.chiscsi_conf         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.disk_geometry        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_client_cert   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_client_cert_key = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_data_namespace = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack sudo[81928]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.driver_use_ssl       = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.extra_capabilities   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.filter_function      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.goodness_function    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iser_helper          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iser_ip_address      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iser_port            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.iser_target_prefix   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_host             = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_login            = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_mount_options    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_password         = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_private_key      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_share_path       = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_ssh_port         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.num_shell_tries      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.nvmet_port_id        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.replication_device   = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.report_discard_supported = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.reserved_percentage  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.scst_target_driver   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.storage_protocol     = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_helper        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_ip_address    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_port          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_prefix        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_protocol      = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.trace_flags          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.use_chap_auth        = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_clear         = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_clear_size    = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] QuobyteHD.volumes_dir          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl      = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_notifications.driver = [] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_notifications.retry = -1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] key_manager.fixed_key          = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.barbican_api_version  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.barbican_endpoint     = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.barbican_endpoint_type = public {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.barbican_region_name  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.cafile                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.certfile              = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.collect_timing        = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.insecure              = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.keyfile               = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.number_of_retries     = 60 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.retry_delay           = 1 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.send_service_user_token = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.split_loggers         = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.timeout               = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.verify_ssl            = True {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican.verify_ssl_path       = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.auth_section = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.auth_type = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.cafile   = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.certfile = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.collect_timing = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.insecure = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.keyfile  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.split_loggers = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] barbican_service_user.timeout  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.approle_role_id          = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.approle_secret_id        = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.kv_mountpoint            = secret {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.kv_path                  = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.kv_version               = 2 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.namespace                = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.root_token_id            = **** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.ssl_ca_crt_file          = None {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.timeout                  = 60.0 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.use_ssl                  = False {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 01:05:55 devstack cinder-volume[81676]: DEBUG oslo_service.backend._eventlet.service [None req-6c681f7a-671a-406d-b54b-3ff1789072cd None None] ******************************************************************************** {{(pid=81676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.527s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.volume.driver [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.driver [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6693420410156, 'free_capacity_gb': 1775.6693420410156, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81902) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_db.sqlalchemy.engines [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writer thread running {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.db.sqlalchemy.api [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Building query based on filter {{(pid=81902) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81902) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.keymgr.migration [None req-9fc97b99-0f35-40f6-9ab5-da26d65f0397 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 01:05:55 devstack sudo[81949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:55 devstack sudo[81949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:55 devstack sudo[81949]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.457s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Driver initialization completed successfully.
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Initiating service 3 cleanup
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Service 3 cleanup completed.
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.service [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Creating RPC server for service cinder-volume {{(pid=81902) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.service [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81902) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 01:05:55 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:05:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:05:55 devstack sudo[81959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:05:55 devstack sudo[81959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:05:56 devstack sudo[81959]: pam_unix(sudo:session): session closed for user root
Apr 24 01:05:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.494s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:05:56 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-04d78895-ba65-4ce5-9887-3bcf6b8f5624 None None] Driver post RPC initialization completed successfully.
Apr 24 01:06:04 devstack cinder-volume[81676]: DEBUG dbcounter [-] [81676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:06:05 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:06:06 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=3 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:19 devstack sudo[82483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:07:19 devstack sudo[82483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:19 devstack sudo[82483]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.592s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Flow 'volume_create_manager' (f22f3d4e-afcf-4e6a-93e2-d11d8cb4f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da51466-1b0c-4a61-a984-524d0a3aaa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da51466-1b0c-4a61-a984-524d0a3aaa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1701666234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e161c0dc-634e-4d81-88bc-8c1890303088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00c0e3a23f445c297174988841fd91f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:38Z,use_quota=True,user_id='229fee82ed924a578cb3b74df231b811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d98cfe-2845-41a8-8c46-7f3d84143cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d98cfe-2845-41a8-8c46-7f3d84143cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44cdd6c-06ef-4357-9225-8e45fda0bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44cdd6c-06ef-4357-9225-8e45fda0bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e161c0dc-634e-4d81-88bc-8c1890303088', 'volume_name': 'volume-e161c0dc-634e-4d81-88bc-8c1890303088', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51026cfa-386a-45f1-b5b1-49b7d51953d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51026cfa-386a-45f1-b5b1-49b7d51953d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ed20f3-606e-42f9-be76-c03c55ca03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:38 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Volume e161c0dc-634e-4d81-88bc-8c1890303088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e161c0dc-634e-4d81-88bc-8c1890303088', 'volume_size': 1}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1701666234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e161c0dc-634e-4d81-88bc-8c1890303088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00c0e3a23f445c297174988841fd91f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:38Z,use_quota=True,user_id='229fee82ed924a578cb3b74df231b811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Creating volume e161c0dc-634e-4d81-88bc-8c1890303088 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:07:38 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:07:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:38 devstack sudo[82657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 1073741824
Apr 24 01:07:38 devstack sudo[82657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:40 devstack sudo[82657]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 1073741824" returned: 0 in 2.239s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:41 devstack sudo[82978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088
Apr 24 01:07:41 devstack sudo[82978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:42 devstack sudo[82978]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088" returned: 0 in 1.673s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] <== create_volume: return (4057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.065s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ed20f3-606e-42f9-be76-c03c55ca03a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e161c0dc-634e-4d81-88bc-8c1890303088', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4f64b5-f886-4db2-ab74-432bdf646c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Volume volume-e161c0dc-634e-4d81-88bc-8c1890303088 (e161c0dc-634e-4d81-88bc-8c1890303088): created successfully
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4f64b5-f886-4db2-ab74-432bdf646c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Flow 'volume_create_manager' (f22f3d4e-afcf-4e6a-93e2-d11d8cb4f86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:07:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d29fe767-ce52-4e31-928a-d8101bd3ec00 tempest-VolumesAdminNegativeTest-1513267505 None] Created volume successfully.
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Flow 'volume_create_manager' (6c74a775-bd2b-40be-a26d-f030bdd24f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c909bb-7c6d-4a18-ab92-c3aff3a13e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c909bb-7c6d-4a18-ab92-c3aff3a13e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-602512042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81a32d252c40b5a922b50de0cc6d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:44Z,use_quota=True,user_id='fd13b74abbac4abb84af9d6b6ec995ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa7af18-c51d-4d9d-af1c-a4ab4c89d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa7af18-c51d-4d9d-af1c-a4ab4c89d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a32fffb-27e0-4902-939e-d58ec2a9a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a32fffb-27e0-4902-939e-d58ec2a9a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298', 'volume_name': 'volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc3db9-f27e-4135-bdcb-f0417aa03043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc3db9-f27e-4135-bdcb-f0417aa03043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82e9758-d1a8-4b16-9a46-ce813679c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Volume 1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298', 'volume_size': 1}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-602512042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81a32d252c40b5a922b50de0cc6d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:44Z,use_quota=True,user_id='fd13b74abbac4abb84af9d6b6ec995ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Creating volume 1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:07:44 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:44 devstack sudo[83020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 1073741824
Apr 24 01:07:44 devstack sudo[83020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Acquiring lock "cinder-e161c0dc-634e-4d81-88bc-8c1890303088-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "cinder-e161c0dc-634e-4d81-88bc-8c1890303088-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Acquiring lock "cinder-quobyte-e161c0dc-634e-4d81-88bc-8c1890303088" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:07:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "cinder-quobyte-e161c0dc-634e-4d81-88bc-8c1890303088" acquired by "delete_volume" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:07:44 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgwxw_c6j/privsep.sock']
Apr 24 01:07:44 devstack sudo[83023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgwxw_c6j/privsep.sock
Apr 24 01:07:44 devstack sudo[83023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:45 devstack sudo[83020]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 1073741824" returned: 0 in 1.872s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 24 01:07:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:46 devstack sudo[83032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298
Apr 24 01:07:46 devstack sudo[83032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 01:07:46 devstack cinder-volume[81902]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 24 01:07:47 devstack sudo[83032]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" returned: 0 in 1.539s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] <== create_volume: return (3532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.548s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82e9758-d1a8-4b16-9a46-ce813679c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d11231-6889-43c2-898f-e6c38e4eaab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:47 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Volume volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 (1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298): created successfully
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d11231-6889-43c2-898f-e6c38e4eaab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Flow 'volume_create_manager' (6c74a775-bd2b-40be-a26d-f030bdd24f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:07:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3f4c72b0-99ff-4875-a51d-d00f6080ff10 tempest-DeleteServersTestJSON-651578135 None] Created volume successfully.
Apr 24 01:07:48 devstack sudo[83023]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:48 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Spawned new privsep daemon via rootwrap
Apr 24 01:07:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Accepted privsep connection to /tmp/tmpgwxw_c6j/privsep.sock {{(pid=81902) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 24 01:07:48 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 24 01:07:48 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 24 01:07:48 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 24 01:07:48 devstack cinder-volume[81902]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83038
Apr 24 01:07:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e68103-01ab-47a5-8dc9-94ee1f7dfbe9]: (2,) {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:07:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f65c8-8494-44f3-83a5-913a53d4c850]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:07:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:48 devstack sudo[83045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088
Apr 24 01:07:48 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:49 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088" returned: 0 in 1.955s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:50 devstack sudo[83095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088
Apr 24 01:07:50 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:51 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e161c0dc-634e-4d81-88bc-8c1890303088" returned: 0 in 1.265s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "cinder-quobyte-e161c0dc-634e-4d81-88bc-8c1890303088" released by "delete_volume" :: held 6.576s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:07:51 devstack cinder-volume[81902]: WARNING cinder.quota [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:07:51 devstack cinder-volume[81902]: WARNING cinder.quota [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:07:51 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Created reservations ['9fc93593-d307-4db1-96ad-0ec4eedebcf0', '1cd8a1de-240c-41e9-972d-0ec9faf65ee5', 'cacfcca9-bf65-4b5c-bfd7-78f3ad5ff68b', '284faf6f-67ae-4e28-a734-989eb4166d12'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:52 devstack sudo[83102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:07:52 devstack sudo[83102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:53 devstack sudo[83102]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.888s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:07:53 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:07:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Deleted volume successfully.
Apr 24 01:07:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-599089df-e077-4662-82f1-ab7f22bf3a7b tempest-VolumesAdminNegativeTest-1513267505 None] Lock "cinder-e161c0dc-634e-4d81-88bc-8c1890303088-delete_volume" released by "delete_volume" :: held 9.577s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Flow 'volume_create_manager' (2acd5a1e-9cae-4d4c-b755-f5280e9df196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e232550-2c38-4381-95c5-fc12bf5bbdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e232550-2c38-4381-95c5-fc12bf5bbdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-410054492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47946fe9-a05d-45dc-9e88-f40929812d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886c131be00f410a8034a0e5418a7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:57Z,use_quota=True,user_id='cdf18209486b40049fcc3ddf5185825f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e15764-8d83-4271-b6ba-a4ed62424da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e15764-8d83-4271-b6ba-a4ed62424da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2198a541-bac2-4de7-9b62-8bdc2e71754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2198a541-bac2-4de7-9b62-8bdc2e71754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47946fe9-a05d-45dc-9e88-f40929812d2e', 'volume_name': 'volume-47946fe9-a05d-45dc-9e88-f40929812d2e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f022041c-f6b1-4e70-ad23-741697929c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f022041c-f6b1-4e70-ad23-741697929c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861429ec-762d-498f-9577-09e48c279e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:07:57 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Volume 47946fe9-a05d-45dc-9e88-f40929812d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47946fe9-a05d-45dc-9e88-f40929812d2e', 'volume_size': 1}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-410054492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47946fe9-a05d-45dc-9e88-f40929812d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886c131be00f410a8034a0e5418a7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:57Z,use_quota=True,user_id='cdf18209486b40049fcc3ddf5185825f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Creating volume 47946fe9-a05d-45dc-9e88-f40929812d2e {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:07:57 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:07:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:07:57 devstack sudo[83259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e 1073741824
Apr 24 01:07:57 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:07:58 devstack cinder-volume[81902]: WARNING py.warnings [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 24 01:07:58 devstack cinder-volume[81902]:   .first()
Apr 24 01:07:58 devstack cinder-volume[81902]: 
Apr 24 01:07:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:07:58 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root
Apr 24 01:07:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e 1073741824" returned: 0 in 1.208s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:03 devstack sudo[83292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e
Apr 24 01:08:03 devstack sudo[83292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:03 devstack sudo[83292]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] <== create_volume: return (6391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 6.395s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.409s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861429ec-762d-498f-9577-09e48c279e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47946fe9-a05d-45dc-9e88-f40929812d2e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe91bfb-5ec0-40f9-b8e5-b109401e2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740ceb8-738f-4224-8295-1010f859a630]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Volume volume-47946fe9-a05d-45dc-9e88-f40929812d2e (47946fe9-a05d-45dc-9e88-f40929812d2e): created successfully
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe91bfb-5ec0-40f9-b8e5-b109401e2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Flow 'volume_create_manager' (2acd5a1e-9cae-4d4c-b755-f5280e9df196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:08:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-472586de-4b4f-4df6-b252-5044dd9577eb tempest-ServerRescueNegativeTestJSON-825266897 None] Created volume successfully.
Apr 24 01:08:04 devstack sudo[83296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298
Apr 24 01:08:04 devstack sudo[83296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:04 devstack sudo[83296]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" returned: 0 in 0.624s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.671s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054', 'name': 'volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85f91ebb-e780-4195-95f6-53ca03ec84e4', 'enforce_multipath': True} {{(pid=81902) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 01:08:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-b1df3aec-2047-4803-b916-799ac3bc3052 req-b9cac55c-48a0-4f3a-8942-e963d5db63c7 tempest-DeleteServersTestJSON-651578135 None] attachment_update completed successfully.
Apr 24 01:08:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4460b20c-2861-4d00-81a6-7e66b417619b tempest-BackendsCapabilitiesAdminTestsJSON-1547075359 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6693420410156, 'free_capacity_gb': 1775.6693420410156, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81902) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 01:08:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a804adc0-a97f-44f1-9907-35ba7ffa710e tempest-BackendsCapabilitiesAdminTestsJSON-1547075359 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6693420410156, 'free_capacity_gb': 1775.6693420410156, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81902) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 01:08:14 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=17,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=4 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:08:14 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=18,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:08:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-161fccc5-0070-4489-9e29-3d434bccfa8d req-53762c34-94ad-4935-a87f-8cfa42eac600 tempest-DeleteServersTestJSON-651578135 None] Terminate volume connection completed successfully.
Apr 24 01:08:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-161fccc5-0070-4489-9e29-3d434bccfa8d req-53762c34-94ad-4935-a87f-8cfa42eac600 tempest-DeleteServersTestJSON-651578135 None] Deleting attachment 85f91ebb-e780-4195-95f6-53ca03ec84e4. {{(pid=81902) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:19 devstack sudo[83881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:08:19 devstack sudo[83881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:20 devstack sudo[83881]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.052s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "cinder-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "cinder-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "cinder-quobyte-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "cinder-quobyte-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f19a4-3a08-4c04-9ef7-a4e5070d3c97]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:21 devstack sudo[83885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298
Apr 24 01:08:21 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:22 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" returned: 0 in 1.117s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:22 devstack sudo[83890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298
Apr 24 01:08:22 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:22 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" returned: 0 in 0.667s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "cinder-quobyte-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298" released by "delete_volume" :: held 1.864s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Created reservations ['f0816eb6-d891-4067-860b-4501320c4f06', 'e0a988bc-9050-43a9-ab38-f78e6535a5cd', 'a785f782-e4b6-4268-bdf0-012a784767d9', 'ad4769ff-1baf-4ca2-a71b-36b47f5a5908'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:22 devstack sudo[83895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:08:22 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:23 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4b4534d0-5afc-4d0f-9031-51f608ef6370 tempest-GroupsV314Test-270523085 None] Group tempest-GroupsV314Test-Group-493914921: creating
Apr 24 01:08:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.978s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:08:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Deleted volume successfully.
Apr 24 01:08:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4b4534d0-5afc-4d0f-9031-51f608ef6370 tempest-GroupsV314Test-270523085 None] Group tempest-GroupsV314Test-Group-493914921: created successfully
Apr 24 01:08:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4b4534d0-5afc-4d0f-9031-51f608ef6370 tempest-GroupsV314Test-270523085 None] Create group completed successfully.
Apr 24 01:08:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-74f3c1a8-83e3-4f14-af8a-a546a28f6072 tempest-DeleteServersTestJSON-651578135 None] Lock "cinder-1c9009cf-0a1e-4f9d-8f6e-4c876a2a2298-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Flow 'volume_create_manager' (a3a07d83-d084-498f-8f62-2cc8016003f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ed30ad-a7c3-4207-aef4-115f862b88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ed30ad-a7c3-4207-aef4-115f862b88fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1327776323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c74b6643-399c-4750-b460-f7e166b1b943,host='devstack@QuobyteHD#QuobyteHD',id=5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d447b163e6945a0955afa92ee0faf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:26Z,use_quota=True,user_id='9052f083116e4cb6ab3b519a8d2ede74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06decc3d-7297-4c1a-a9b0-fbe50477c0d0),volume_type_id=06decc3d-7297-4c1a-a9b0-fbe50477c0d0)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbe6c6-9111-4124-9189-1c57fb52e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbe6c6-9111-4124-9189-1c57fb52e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bdf67c-64bd-42cb-81ee-abefb241ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bdf67c-64bd-42cb-81ee-abefb241ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1', 'volume_name': 'volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64c5029-fd92-429a-abc5-08910a21b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64c5029-fd92-429a-abc5-08910a21b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc095baa-180a-4dbc-9cd0-6999dc685225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Volume 5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1', 'volume_size': 1}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c74b6643-399c-4750-b460-f7e166b1b943,created_at=2026-04-23T23:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1327776323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c74b6643-399c-4750-b460-f7e166b1b943,host='devstack@QuobyteHD#QuobyteHD',id=5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d447b163e6945a0955afa92ee0faf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:26Z,use_quota=True,user_id='9052f083116e4cb6ab3b519a8d2ede74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06decc3d-7297-4c1a-a9b0-fbe50477c0d0),volume_type_id=06decc3d-7297-4c1a-a9b0-fbe50477c0d0)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Creating volume 5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:08:25 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:08:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:25 devstack sudo[83942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 1073741824
Apr 24 01:08:25 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:27 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 1073741824" returned: 0 in 1.366s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:27 devstack sudo[83978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:27 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:28 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.902s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc095baa-180a-4dbc-9cd0-6999dc685225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3428fcf-eb32-4445-b4ac-abdf72e0785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:28 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Volume volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 (5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1): created successfully
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3428fcf-eb32-4445-b4ac-abdf72e0785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Flow 'volume_create_manager' (a3a07d83-d084-498f-8f62-2cc8016003f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:08:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-46c783f3-ef79-4d31-9b70-77b5568251d7 tempest-GroupsV314Test-270523085 None] Created volume successfully.
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Acquiring lock "cinder-47946fe9-a05d-45dc-9e88-f40929812d2e-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "cinder-47946fe9-a05d-45dc-9e88-f40929812d2e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Acquiring lock "cinder-quobyte-47946fe9-a05d-45dc-9e88-f40929812d2e" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "cinder-quobyte-47946fe9-a05d-45dc-9e88-f40929812d2e" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[28117444-8b42-445f-b15c-d3f63d381e9e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:28 devstack sudo[83985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e
Apr 24 01:08:28 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:29 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e" returned: 0 in 0.847s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:29 devstack sudo[83990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e
Apr 24 01:08:29 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:30 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-47946fe9-a05d-45dc-9e88-f40929812d2e" returned: 0 in 0.899s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "cinder-quobyte-47946fe9-a05d-45dc-9e88-f40929812d2e" released by "delete_volume" :: held 1.855s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Created reservations ['c077302a-ad6c-446a-90d8-eb7a8e6d8253', 'f61b7393-8c75-4deb-b2b6-7d8fcbb3e42e', 'e1153e7b-116b-4213-9808-1f17ce5d6bf5', 'b85bff59-2521-4483-9a77-40980d6c20e7'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:30 devstack sudo[84025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:08:30 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:31 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Cloning volume 5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 to volume 034a76da-433c-4432-8a1b-3ec133be13b3
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Creating offline snapshot 431064d8-f6b2-4116-9dd7-002cded0801f of volume 5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133557b-b654-47ef-afbc-d218d1a88004]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:31 devstack sudo[84031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:31 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:31 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.149s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:08:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Deleted volume successfully.
Apr 24 01:08:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-147d428e-da25-47a8-88ed-9ada9f40b8af tempest-ServerRescueNegativeTestJSON-825266897 None] Lock "cinder-47946fe9-a05d-45dc-9e88-f40929812d2e-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:32 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 1.510s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:32 devstack sudo[84059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f 1G
Apr 24 01:08:32 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:34 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f 1G" returned: 0 in 1.300s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:34 devstack sudo[84074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:34 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:35 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 1.094s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:35 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:08:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:35 devstack sudo[84081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:35 devstack sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Flow 'volume_create_manager' (408a1b4e-cc1e-4186-b014-7097dcd5c431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4821427d-9c0c-4fd0-9b59-97771dc33cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4821427d-9c0c-4fd0-9b59-97771dc33cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1261933054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fb5413-d6f2-4790-b0b8-4da75e91c986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a311949872654720804395d7b6540638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:36Z,use_quota=True,user_id='2a063d456cf34519a316682a0587d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:36 devstack sudo[84081]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11be72ca-f5fd-4f01-b5a7-2dd5e9668ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11be72ca-f5fd-4f01-b5a7-2dd5e9668ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745c8ed4-f4b9-4cf9-a93c-d2ee359e67e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745c8ed4-f4b9-4cf9-a93c-d2ee359e67e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fb5413-d6f2-4790-b0b8-4da75e91c986', 'volume_name': 'volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60a0746-3c5b-4869-8f12-15a01a1b6ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60a0746-3c5b-4869-8f12-15a01a1b6ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da614fad-f542-48c5-b579-0612e3eda801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:36 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Volume f6fb5413-d6f2-4790-b0b8-4da75e91c986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986', 'volume_size': 1}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 1.021s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:36 devstack sudo[84084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info
Apr 24 01:08:36 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:36 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info" returned: 0 in 0.693s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:36 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:08:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:37 devstack sudo[84087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info
Apr 24 01:08:37 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:37 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.info" returned: 0 in 0.591s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Acquiring lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] snapshot: 431064d8-f6b2-4116-9dd7-002cded0801f, volume: 034a76da-433c-4432-8a1b-3ec133be13b3,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[94815ea1-5505-463e-995e-b1e9a841d0aa]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:37 devstack sudo[84090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:37 devstack sudo[84090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:38 devstack sudo[84090]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 0.743s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be8e76-fde2-4aa3-8281-0b1a3e79291d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:38 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:38 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:39 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.811s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:39 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:08:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:39 devstack sudo[84101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3
Apr 24 01:08:39 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:46 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=1 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:08:46 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=2 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:08:46 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3" returned: 0 in 7.169s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:46 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0d051c-7257-42f2-8f6a-c1141f40e5cf]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:46 devstack sudo[84166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:46 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:47 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.801s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:08:47 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Converted 1024.00 MB image at 142.80 MB/s
Apr 24 01:08:47 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:47 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3
Apr 24 01:08:47 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:47 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3" returned: 0 in 0.579s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" released by "_copy_volume_from_snapshot" :: held 10.197s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Acquiring lock "cinder-quobyte-431064d8-f6b2-4116-9dd7-002cded0801f" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-431064d8-f6b2-4116-9dd7-002cded0801f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Deleting offline snapshot 431064d8-f6b2-4116-9dd7-002cded0801f of volume 5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] snapshot_file for this snap is: volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a467da-8bc4-4354-a47c-13de42440520]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:48 devstack sudo[84177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:48 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:48 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 0.734s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:08:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca833e6-789d-4581-83be-9952a9c8a0fc]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:48 devstack sudo[84182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:48 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:49 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.646s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:49 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:49 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:50 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 0.830s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:50 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f
Apr 24 01:08:50 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:50 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1.431064d8-f6b2-4116-9dd7-002cded0801f" returned: 0 in 0.676s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-431064d8-f6b2-4116-9dd7-002cded0801f" released by "_delete_snapshot" :: held 3.046s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.829s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.711s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1261933054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fb5413-d6f2-4790-b0b8-4da75e91c986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a311949872654720804395d7b6540638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:36Z,use_quota=True,user_id='2a063d456cf34519a316682a0587d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Creating volume f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:08:50 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:08:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:50 devstack sudo[84196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 1073741824
Apr 24 01:08:50 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-133079b2-c81f-4f0e-a914-dfb65b06299b tempest-GroupsV314Test-270523085 None] Create group from source-group-c74b6643-399c-4750-b460-f7e166b1b943 completed successfully.
Apr 24 01:08:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Acquiring lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" acquired by "delete_volume" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[874570c6-3a0a-4be3-b15e-077018ad4f16]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:52 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 1073741824" returned: 0 in 1.066s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:52 devstack sudo[84201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3
Apr 24 01:08:52 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:52 devstack sudo[84203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986
Apr 24 01:08:52 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:52 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3" returned: 0 in 0.843s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:52 devstack sudo[84210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3
Apr 24 01:08:52 devstack sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:52 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986" returned: 0 in 0.719s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da614fad-f542-48c5-b579-0612e3eda801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb6c82c-de4e-4c2f-971f-c79ac11446a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:08:52 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Volume volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 (f6fb5413-d6f2-4790-b0b8-4da75e91c986): created successfully
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb6c82c-de4e-4c2f-971f-c79ac11446a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:08:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Flow 'volume_create_manager' (408a1b4e-cc1e-4186-b014-7097dcd5c431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:08:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-feb7f613-de8e-4626-a49d-87138f3df27f req-1a8de498-2648-4f64-a9f8-01e0dd42dba5 tempest-VolumesSnapshotsTestJSON-715094161 None] Created volume successfully.
Apr 24 01:08:53 devstack sudo[84210]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-034a76da-433c-4432-8a1b-3ec133be13b3" returned: 0 in 0.776s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-034a76da-433c-4432-8a1b-3ec133be13b3" released by "delete_volume" :: held 1.685s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Created reservations ['3f29c0f1-02cd-4f36-88f9-b14cf34efa7d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:53 devstack cinder-volume[81902]: WARNING cinder.quota [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-299317873 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-299317873, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:08:53 devstack cinder-volume[81902]: WARNING cinder.quota [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-299317873 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-299317873, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Created reservations ['20f83e50-1e51-44e5-b49c-f1598897b4e7', '672cd97f-5f55-4eac-aa39-b8042575681e', '6fca51dd-e7fe-4b28-a29f-3cdaa18efc75', '5afb9a84-6d27-41f5-8a3f-58859726a644'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Creating offline snapshot 461f2982-f5c6-485c-abac-0d523aa1099b of volume f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae308995-4631-443e-b2c1-432883618e74]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:53 devstack sudo[84218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986
Apr 24 01:08:53 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:54 devstack sudo[84220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:08:54 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Acquiring lock "cinder-quobyte-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:54 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986" returned: 0 in 0.902s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" acquired by "delete_volume" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:54 devstack sudo[84227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b 1G
Apr 24 01:08:54 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3386327-8e5b-4382-a4cb-eb8fde16b4e0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:54 devstack sudo[84230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:54 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:54 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.959s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:54 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:08:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7953f52b-79c4-4a54-81df-64a136aa5e8b tempest-GroupsV314Test-270523085 None] Delete group completed successfully.
Apr 24 01:08:55 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b 1G" returned: 0 in 0.818s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:55 devstack sudo[84239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b
Apr 24 01:08:55 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:55 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.808s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:55 devstack sudo[84241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1
Apr 24 01:08:55 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:56 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" returned: 0 in 0.590s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Lock "cinder-quobyte-5f1509ed-1ead-41a9-80b8-4e5caa9cdbb1" released by "delete_volume" :: held 1.489s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:08:56 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b" returned: 0 in 0.754s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:56 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b is being set with open permissions: ugo+rw
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:56 devstack sudo[84247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b
Apr 24 01:08:56 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Created reservations ['54ec4c02-8483-4a56-9379-fe9267f010ee'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Created reservations ['6f3492d9-a02f-491a-a63a-8343f86b0833', 'c5a69705-9c9a-4083-ad94-cee4180af3f6', '9b4893d6-0225-4fdf-ae92-9e406489a98e', '9a1ba27f-ab2c-4c30-ae09-552324d47ee2'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:56 devstack sudo[84249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:08:56 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:56 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b" returned: 0 in 0.556s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:56 devstack sudo[84252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info
Apr 24 01:08:56 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:57 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.698s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:57 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:08:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e5f218e2-6f20-4f11-a498-2aec2d47c9ed tempest-GroupsV314Test-270523085 None] Delete group completed successfully.
Apr 24 01:08:57 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:57 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info is being set with open permissions: ugo+rw
Apr 24 01:08:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:57 devstack sudo[84256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info
Apr 24 01:08:57 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:08:58 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root
Apr 24 01:08:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.info" returned: 0 in 0.718s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:08:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:08:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-6fb1dffe-af61-4cc5-b881-97bcad60643d req-fd6e2446-c8b1-4d75-9e4d-00676a5ce029 tempest-VolumesSnapshotsTestJSON-715094161 None] Create snapshot completed successfully
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "cinder-461f2982-f5c6-485c-abac-0d523aa1099b-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-461f2982-f5c6-485c-abac-0d523aa1099b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "cinder-quobyte-461f2982-f5c6-485c-abac-0d523aa1099b" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-461f2982-f5c6-485c-abac-0d523aa1099b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Deleting offline snapshot 461f2982-f5c6-485c-abac-0d523aa1099b of volume f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] snapshot_file for this snap is: volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d089d-95c9-42cb-9652-ccf6728c5921]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:08:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:08:59 devstack sudo[84260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b
Apr 24 01:08:59 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:00 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b" returned: 0 in 0.765s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:09:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77c7246-3804-4cd1-a7c6-aac6fe15a5c4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:00 devstack sudo[84269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986
Apr 24 01:09:00 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:01 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986" returned: 0 in 0.760s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:01 devstack sudo[84285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b
Apr 24 01:09:01 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:01 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b" returned: 0 in 0.733s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:01 devstack sudo[84292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b
Apr 24 01:09:01 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:02 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986.461f2982-f5c6-485c-abac-0d523aa1099b" returned: 0 in 0.630s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-461f2982-f5c6-485c-abac-0d523aa1099b" released by "_delete_snapshot" :: held 3.038s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" released by "delete_snapshot" :: held 3.065s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:02 devstack cinder-volume[81902]: WARNING cinder.quota [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:09:02 devstack cinder-volume[81902]: DEBUG cinder.quota [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Created reservations ['50c96f9e-08eb-4ee3-9921-5a1dabe9034b', '8799bda7-0af2-4ff3-92e3-00a29804e74e', 'fc30c6dc-c51c-460c-a8a0-c25f3156701b', '7f25388e-15f2-4ce0-be4b-aa13793ed4e9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Delete snapshot completed successfully.
Apr 24 01:09:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-7f4f8ce5-0095-47db-a023-6e5c21dfb68f req-4594e2d7-d357-4fff-aa4d-de0c5cb33945 tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-461f2982-f5c6-485c-abac-0d523aa1099b-delete_snapshot" released by "delete_snapshot" :: held 3.343s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "cinder-f6fb5413-d6f2-4790-b0b8-4da75e91c986-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-f6fb5413-d6f2-4790-b0b8-4da75e91c986-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" acquired by "delete_volume" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b309b9-b038-4e33-a240-0aa494614eb9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:03 devstack sudo[84297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986
Apr 24 01:09:03 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:04 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986" returned: 0 in 0.960s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:04 devstack sudo[84304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986
Apr 24 01:09:04 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:04 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6fb5413-d6f2-4790-b0b8-4da75e91c986" returned: 0 in 0.766s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-quobyte-f6fb5413-d6f2-4790-b0b8-4da75e91c986" released by "delete_volume" :: held 1.821s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG cinder.quota [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Created reservations ['cb53b921-29e2-4ffd-8543-aa94fe666ed3', '91f381ad-ea17-4e69-880a-a16ac42db05f', '70a59714-2c9e-4a67-81eb-81a2323bf7f0', 'a9c2531d-3579-473a-99fe-71dbc2368526'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:05 devstack sudo[84307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:05 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:06 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.834s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.manager [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:06 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Deleted volume successfully.
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-d6bd1e52-de64-41c5-af45-bd1cedb363da req-6232c2e4-8b81-4ceb-9878-225c0157243d tempest-VolumesSnapshotsTestJSON-715094161 None] Lock "cinder-f6fb5413-d6f2-4790-b0b8-4da75e91c986-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Flow 'volume_create_manager' (1dc7fb34-e4ca-4818-a494-5e62a344a7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b556d-f1df-409f-a6e3-6dadcc88811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b556d-f1df-409f-a6e3-6dadcc88811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-848106883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b321375e-82b7-4fe8-9a8b-6b93412bacf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a34b8f90a74efca33bc725b1f108c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:06Z,use_quota=True,user_id='768633f5bf944edab7ff3671c08eb941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a296af42-6edf-4efd-a239-28b6d3025796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a296af42-6edf-4efd-a239-28b6d3025796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e8efc0-125d-4b59-8d5b-1ae550c8862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e8efc0-125d-4b59-8d5b-1ae550c8862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b321375e-82b7-4fe8-9a8b-6b93412bacf4', 'volume_name': 'volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc3e74-1658-4f2e-a920-c87eb96003a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc3e74-1658-4f2e-a920-c87eb96003a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caddb283-e1df-45da-bb1e-8dcd8068d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:06 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Volume b321375e-82b7-4fe8-9a8b-6b93412bacf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4', 'volume_size': 1}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-848106883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b321375e-82b7-4fe8-9a8b-6b93412bacf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a34b8f90a74efca33bc725b1f108c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:06Z,use_quota=True,user_id='768633f5bf944edab7ff3671c08eb941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Creating volume b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:06 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:06 devstack sudo[84310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 1073741824
Apr 24 01:09:06 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:07 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 1073741824" returned: 0 in 1.043s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:07 devstack sudo[84324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4
Apr 24 01:09:07 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:08 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4" returned: 0 in 0.762s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caddb283-e1df-45da-bb1e-8dcd8068d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca409e4e-3af3-48ba-be65-9ccf6a61da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Volume volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 (b321375e-82b7-4fe8-9a8b-6b93412bacf4): created successfully
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca409e4e-3af3-48ba-be65-9ccf6a61da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Flow 'volume_create_manager' (1dc7fb34-e4ca-4818-a494-5e62a344a7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-db103277-0373-4757-987b-6f78cd25be91 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Created volume successfully.
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Creating offline snapshot d5352521-b0d0-4552-afcc-fb2e2ed0a43b of volume b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:09:09 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f74b22-78f5-47f2-905a-95fac9e1e321]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:09 devstack sudo[84331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4
Apr 24 01:09:09 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:10 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4" returned: 0 in 1.156s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:10 devstack sudo[84347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b 1G
Apr 24 01:09:10 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:11 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b 1G" returned: 0 in 1.204s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:11 devstack sudo[84385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b
Apr 24 01:09:11 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (a591c5e8-f7d4-497c-a5f4-2df77ba8ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924363e0-a423-4f80-892d-54bf6cad91b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924363e0-a423-4f80-892d-54bf6cad91b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-150799813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c981a-639d-4c23-a3e9-256892e34e93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:12Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ebc4a2-1616-42c3-a075-fc18acbcc7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ebc4a2-1616-42c3-a075-fc18acbcc7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c13a191-0cb7-4f66-a8ae-91c8432709c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c13a191-0cb7-4f66-a8ae-91c8432709c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095c981a-639d-4c23-a3e9-256892e34e93', 'volume_name': 'volume-095c981a-639d-4c23-a3e9-256892e34e93', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6ded60-1afa-4b48-a589-bb4ea8fa3039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6ded60-1afa-4b48-a589-bb4ea8fa3039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f489e-95a6-4cca-930e-35590a327937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:11 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Volume 095c981a-639d-4c23-a3e9-256892e34e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095c981a-639d-4c23-a3e9-256892e34e93', 'volume_size': 1}
Apr 24 01:09:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:12 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b" returned: 0 in 0.748s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:12 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b is being set with open permissions: ugo+rw
Apr 24 01:09:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:12 devstack sudo[84392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b
Apr 24 01:09:12 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:12 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b" returned: 0 in 0.473s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:12 devstack sudo[84396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info
Apr 24 01:09:12 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:13 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info" returned: 0 in 0.521s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:13 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info is being set with open permissions: ugo+rw
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:13 devstack sudo[84399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info
Apr 24 01:09:13 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:13 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.info" returned: 0 in 0.415s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.681s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-150799813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c981a-639d-4c23-a3e9-256892e34e93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:12Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Creating volume 095c981a-639d-4c23-a3e9-256892e34e93 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:13 devstack sudo[84402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 1073741824
Apr 24 01:09:13 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b0e8d38d-6738-4ecb-bb9b-a0e8c28eb2a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Create snapshot completed successfully
Apr 24 01:09:14 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 1073741824" returned: 0 in 0.733s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:14 devstack sudo[84407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93
Apr 24 01:09:14 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "cinder-d5352521-b0d0-4552-afcc-fb2e2ed0a43b-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-d5352521-b0d0-4552-afcc-fb2e2ed0a43b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "cinder-quobyte-d5352521-b0d0-4552-afcc-fb2e2ed0a43b" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:14 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-d5352521-b0d0-4552-afcc-fb2e2ed0a43b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Deleting offline snapshot d5352521-b0d0-4552-afcc-fb2e2ed0a43b of volume b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] snapshot_file for this snap is: volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93" returned: 0 in 0.575s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd75d272-89a9-43bb-9ef5-5ba0f15fd8e9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f489e-95a6-4cca-930e-35590a327937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095c981a-639d-4c23-a3e9-256892e34e93', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7ec6ef-9547-4e1d-ab9d-dfbd42a893d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Volume volume-095c981a-639d-4c23-a3e9-256892e34e93 (095c981a-639d-4c23-a3e9-256892e34e93): created successfully
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7ec6ef-9547-4e1d-ab9d-dfbd42a893d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (a591c5e8-f7d4-497c-a5f4-2df77ba8ca23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-81ea9007-5b5c-4e71-8d1c-c496c96d7da2 tempest-VolumesTestJSON-433151706 None] Created volume successfully.
Apr 24 01:09:15 devstack sudo[84410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b
Apr 24 01:09:15 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:15 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b" returned: 0 in 0.851s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9164ff-de65-43d9-acc6-2d2c32f3dae2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:16 devstack sudo[84418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4
Apr 24 01:09:16 devstack sudo[84418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:17 devstack sudo[84418]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (accc4a01-2f21-47be-ad33-212ac445fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67f0bbf-3f6c-4f9d-953c-c4202aef47a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4" returned: 0 in 1.380s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67f0bbf-3f6c-4f9d-953c-c4202aef47a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937843355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b3f658-652d-4036-8522-3a80ff026aef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:17Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cf28f3-3dd4-4f28-b631-4dba54bc469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cf28f3-3dd4-4f28-b631-4dba54bc469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c0342-aec3-4200-9e77-50dc7a7b5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c0342-aec3-4200-9e77-50dc7a7b5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b3f658-652d-4036-8522-3a80ff026aef', 'volume_name': 'volume-49b3f658-652d-4036-8522-3a80ff026aef', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b6e24d-1bcb-48ad-a4e3-159dbdaef627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b6e24d-1bcb-48ad-a4e3-159dbdaef627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184b4cd1-a009-4eff-a3f4-49c8f20601c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:17 devstack sudo[84424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b
Apr 24 01:09:17 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Volume 49b3f658-652d-4036-8522-3a80ff026aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b3f658-652d-4036-8522-3a80ff026aef', 'volume_size': 1}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:17 devstack sudo[84424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937843355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b3f658-652d-4036-8522-3a80ff026aef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:17Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Creating volume 49b3f658-652d-4036-8522-3a80ff026aef {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:17 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:17 devstack sudo[84427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef 1073741824
Apr 24 01:09:17 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:18 devstack sudo[84424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b" returned: 0 in 1.091s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:18 devstack sudo[84449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b
Apr 24 01:09:18 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:18 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef 1073741824" returned: 0 in 1.383s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:18 devstack sudo[84453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef
Apr 24 01:09:18 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:19 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4.d5352521-b0d0-4552-afcc-fb2e2ed0a43b" returned: 0 in 0.835s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-d5352521-b0d0-4552-afcc-fb2e2ed0a43b" released by "_delete_snapshot" :: held 4.308s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" released by "delete_snapshot" :: held 4.341s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:19 devstack sudo[84461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:19 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:19 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef" returned: 0 in 0.604s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184b4cd1-a009-4eff-a3f4-49c8f20601c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b3f658-652d-4036-8522-3a80ff026aef', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33bbd2d-1f9b-44d4-b313-d02ba735c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Created reservations ['2c1001c6-22e3-4108-9ac0-f50583313344', '6f158038-b2f3-4410-9a4e-afca8a783ac0', 'f7a01f2d-8a50-445f-bce9-69e9bd18c879', '04f269ab-5782-4179-bc3f-5b001ada1b6b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:19 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Volume volume-49b3f658-652d-4036-8522-3a80ff026aef (49b3f658-652d-4036-8522-3a80ff026aef): created successfully
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33bbd2d-1f9b-44d4-b313-d02ba735c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (accc4a01-2f21-47be-ad33-212ac445fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:19 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3c26e746-6f97-48cf-87c2-24e499cb3f75 tempest-VolumesTestJSON-433151706 None] Created volume successfully.
Apr 24 01:09:19 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Delete snapshot completed successfully.
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8d682076-332e-47c1-bf98-84171afae2e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-d5352521-b0d0-4552-afcc-fb2e2ed0a43b-delete_snapshot" released by "delete_snapshot" :: held 4.633s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:19 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.558s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "cinder-b321375e-82b7-4fe8-9a8b-6b93412bacf4-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-b321375e-82b7-4fe8-9a8b-6b93412bacf4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab732f-54eb-4d52-ad55-5ad6ea675ab2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:20 devstack sudo[84465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4
Apr 24 01:09:20 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (b5d6836d-a908-46ad-aa72-441f44a34610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54585685-b9f4-4703-b4f0-cc421dbe429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54585685-b9f4-4703-b4f0-cc421dbe429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1689401423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3356ce5-3eff-479f-9860-82a977e87fe9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:21Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e56be-deb9-4cb0-a28e-c52d53184351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e56be-deb9-4cb0-a28e-c52d53184351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebe2f7-5caf-413a-a129-714bbe53ff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebe2f7-5caf-413a-a129-714bbe53ff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3356ce5-3eff-479f-9860-82a977e87fe9', 'volume_name': 'volume-e3356ce5-3eff-479f-9860-82a977e87fe9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420eb193-01eb-4b38-aec1-8d04b4c1ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420eb193-01eb-4b38-aec1-8d04b4c1ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e36533-f443-4e8a-99bb-5ac9d3d2c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:21 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Volume e3356ce5-3eff-479f-9860-82a977e87fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3356ce5-3eff-479f-9860-82a977e87fe9', 'volume_size': 1}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1689401423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3356ce5-3eff-479f-9860-82a977e87fe9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58c2597be374ef6b9ee16b5f6850a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:21Z,use_quota=True,user_id='ecbe8df0b0a641e4ae8b8d7caa6d9dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Creating volume e3356ce5-3eff-479f-9860-82a977e87fe9 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:21 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:21 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 1073741824
Apr 24 01:09:21 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:21 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4" returned: 0 in 0.950s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:21 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4
Apr 24 01:09:21 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:22 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b321375e-82b7-4fe8-9a8b-6b93412bacf4" returned: 0 in 0.599s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-quobyte-b321375e-82b7-4fe8-9a8b-6b93412bacf4" released by "delete_volume" :: held 1.657s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Created reservations ['132a6c37-5d9c-452e-b05e-6d9763222270', '5acb954d-7abc-425b-9f1d-92f69869b6e8', '65662f72-cb40-474f-a7ad-17829f6e7cd5', '18e02a94-95d0-4fe1-88fb-e8161d15b47c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:22 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 1073741824" returned: 0 in 0.937s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:22 devstack sudo[84479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9
Apr 24 01:09:22 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:22 devstack sudo[84481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:22 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:23 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9" returned: 0 in 0.675s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e36533-f443-4e8a-99bb-5ac9d3d2c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3356ce5-3eff-479f-9860-82a977e87fe9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df5026e-d150-42fe-9397-4a7fed3863eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:23 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Volume volume-e3356ce5-3eff-479f-9860-82a977e87fe9 (e3356ce5-3eff-479f-9860-82a977e87fe9): created successfully
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df5026e-d150-42fe-9397-4a7fed3863eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Flow 'volume_create_manager' (b5d6836d-a908-46ad-aa72-441f44a34610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-db8edbd4-a655-41e0-8ef7-0a9187b2f152 tempest-VolumesTestJSON-433151706 None] Created volume successfully.
Apr 24 01:09:23 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.865s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Deleted volume successfully.
Apr 24 01:09:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-61e07e65-26a9-481c-bda8-260179ccf485 tempest-VolumeSnapshotQuotasNegativeTestJSON-563476642 None] Lock "cinder-b321375e-82b7-4fe8-9a8b-6b93412bacf4-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-e3356ce5-3eff-479f-9860-82a977e87fe9-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "cinder-e3356ce5-3eff-479f-9860-82a977e87fe9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-quobyte-e3356ce5-3eff-479f-9860-82a977e87fe9" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-e3356ce5-3eff-479f-9860-82a977e87fe9" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[61787f00-9ba0-40f8-9fee-90ad7f8058c5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:25 devstack sudo[84531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9
Apr 24 01:09:25 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:26 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9" returned: 0 in 1.389s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:26 devstack sudo[84571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9
Apr 24 01:09:26 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:27 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3356ce5-3eff-479f-9860-82a977e87fe9" returned: 0 in 0.876s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-e3356ce5-3eff-479f-9860-82a977e87fe9" released by "delete_volume" :: held 2.409s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:27 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Created reservations ['ee401d01-18a8-4acf-91eb-d756cf279e5e', '9e82e869-cb0a-4690-9d8f-9d6c1b1a7f11', '9075ad66-1bd1-4de0-8f7c-26e2b2dd0150', 'd94400ba-65a2-4e37-bbf2-c6e76dcb4361'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:28 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:28 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-49b3f658-652d-4036-8522-3a80ff026aef-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "cinder-49b3f658-652d-4036-8522-3a80ff026aef-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-quobyte-49b3f658-652d-4036-8522-3a80ff026aef" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-49b3f658-652d-4036-8522-3a80ff026aef" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[037594be-583f-4a2b-a46b-72aa1b4f9937]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:29 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.401s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Deleted volume successfully.
Apr 24 01:09:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-658b44e9-1897-40c6-bf3f-704235fdc7cb tempest-VolumesTestJSON-433151706 None] Lock "cinder-e3356ce5-3eff-479f-9860-82a977e87fe9-delete_volume" released by "delete_volume" :: held 4.301s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:29 devstack sudo[84610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef
Apr 24 01:09:29 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:30 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef" returned: 0 in 1.145s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:30 devstack sudo[84616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef
Apr 24 01:09:30 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:31 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-49b3f658-652d-4036-8522-3a80ff026aef" returned: 0 in 0.778s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-49b3f658-652d-4036-8522-3a80ff026aef" released by "delete_volume" :: held 1.998s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Created reservations ['4f7c0589-e598-4721-a3e8-86e70aa67005', '75055274-9e1e-4e84-8030-2dc7aa8ec467', '50e960e7-9e20-48cf-ade9-3dfec504c4d9', 'f05832aa-0fd1-4221-a7a9-bf46fe45860e'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:31 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:31 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:32 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.878s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Deleted volume successfully.
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-aeac71f0-52b8-47e4-a8fb-c80d3343ff4e tempest-VolumesTestJSON-433151706 None] Lock "cinder-49b3f658-652d-4036-8522-3a80ff026aef-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-095c981a-639d-4c23-a3e9-256892e34e93-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "cinder-095c981a-639d-4c23-a3e9-256892e34e93-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Acquiring lock "cinder-quobyte-095c981a-639d-4c23-a3e9-256892e34e93" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-095c981a-639d-4c23-a3e9-256892e34e93" acquired by "delete_volume" :: waited 0.056s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd799c1-3159-4cf4-b9b4-afbd5f990e67]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:33 devstack sudo[84666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93
Apr 24 01:09:33 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:34 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93" returned: 0 in 1.038s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:34 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93
Apr 24 01:09:34 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Flow 'volume_create_manager' (8dd922ec-0a5d-40b5-9e5e-e92807e1d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5dcdf-bc52-4617-8e3c-14a3ac746c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5dcdf-bc52-4617-8e3c-14a3ac746c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-528053956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc52959c-ac38-4645-998b-d0fd4ee5f1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fb7b8f3b0645dd9cc9b287124eef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:34Z,use_quota=True,user_id='f7d02cd451854887aea270702ba11d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517dda5b-d202-45ea-b639-c2c660a8f459),volume_type_id=517dda5b-d202-45ea-b639-c2c660a8f459)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ff4d1-4908-4686-a35e-d62660a1461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ff4d1-4908-4686-a35e-d62660a1461a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257d2887-292b-4fda-92cb-80ff3381a51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257d2887-292b-4fda-92cb-80ff3381a51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc52959c-ac38-4645-998b-d0fd4ee5f1e7', 'volume_name': 'volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba3d6e9-19fa-4903-a3e9-d8af74dc3bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba3d6e9-19fa-4903-a3e9-d8af74dc3bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a164f9a-06c9-495d-9776-4b088a08f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:34 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Volume dc52959c-ac38-4645-998b-d0fd4ee5f1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7', 'volume_size': 1}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-528053956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc52959c-ac38-4645-998b-d0fd4ee5f1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fb7b8f3b0645dd9cc9b287124eef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:34Z,use_quota=True,user_id='f7d02cd451854887aea270702ba11d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(517dda5b-d202-45ea-b639-c2c660a8f459),volume_type_id=517dda5b-d202-45ea-b639-c2c660a8f459)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Creating volume dc52959c-ac38-4645-998b-d0fd4ee5f1e7 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:34 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:34 devstack sudo[84676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 1073741824
Apr 24 01:09:34 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:34 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-095c981a-639d-4c23-a3e9-256892e34e93" returned: 0 in 0.636s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "cinder-quobyte-095c981a-639d-4c23-a3e9-256892e34e93" released by "delete_volume" :: held 1.755s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Created reservations ['33d85086-fbf0-4d56-a4eb-2be03ff8baf5', 'c7ac090d-1edd-4b74-9d78-98d5bcb57d7e', 'e6cf49c1-9973-4624-9324-4f1fbb138674', 'f0da9325-d6df-4e32-8fd4-91ddac94b2fe'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:34 devstack sudo[84679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:34 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:35 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 1073741824" returned: 0 in 0.880s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:35 devstack sudo[84685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7
Apr 24 01:09:35 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:35 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.760s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:35 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:35 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Deleted volume successfully.
Apr 24 01:09:35 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-65fc585d-b04d-4a3a-9ba8-219d56d855a6 tempest-VolumesTestJSON-433151706 None] Lock "cinder-095c981a-639d-4c23-a3e9-256892e34e93-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:36 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" returned: 0 in 0.754s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a164f9a-06c9-495d-9776-4b088a08f647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4490d76f-f5fc-48bd-9ece-f1ee803333e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:36 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Volume volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 (dc52959c-ac38-4645-998b-d0fd4ee5f1e7): created successfully
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4490d76f-f5fc-48bd-9ece-f1ee803333e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Flow 'volume_create_manager' (8dd922ec-0a5d-40b5-9e5e-e92807e1d5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-00204f34-c1ee-41bb-a1ae-d8ae3be0f0d3 tempest-VolumeTypesAccessTest-1869257677 None] Created volume successfully.
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Acquiring lock "cinder-dc52959c-ac38-4645-998b-d0fd4ee5f1e7-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "cinder-dc52959c-ac38-4645-998b-d0fd4ee5f1e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Acquiring lock "cinder-quobyte-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "cinder-quobyte-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c69640-4867-4af3-b276-dbd85e43a658]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:37 devstack sudo[84688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7
Apr 24 01:09:37 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:38 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" returned: 0 in 1.623s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:38 devstack sudo[84696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7
Apr 24 01:09:38 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:39 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" returned: 0 in 1.188s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "cinder-quobyte-dc52959c-ac38-4645-998b-d0fd4ee5f1e7" released by "delete_volume" :: held 2.878s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:39 devstack cinder-volume[81902]: WARNING cinder.quota [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1438325658 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1438325658, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:09:39 devstack cinder-volume[81902]: WARNING cinder.quota [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1438325658 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1438325658, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Created reservations ['f06fa747-6d65-43fb-ada3-d707dd207aa6', '1924d67e-df92-4f90-9da5-1e6bd303e653', 'dc741dee-928f-4185-8160-c2359827bb7c', '8736faf2-c380-4942-b1e8-a57d7937654a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:39 devstack sudo[84737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:09:39 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:40 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.978s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:40 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:09:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Deleted volume successfully.
Apr 24 01:09:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d3a5325-49b8-4b9c-bb3a-f58cf16e2868 tempest-VolumeTypesAccessTest-1869257677 None] Lock "cinder-dc52959c-ac38-4645-998b-d0fd4ee5f1e7-delete_volume" released by "delete_volume" :: held 4.244s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Flow 'volume_create_manager' (8b43b7c6-86ef-4eea-9871-84e5f0f8b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a613f5-b0a3-4388-bd53-5dfcaea6a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a613f5-b0a3-4388-bd53-5dfcaea6a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:41Z,deleted=False,deleted_at=None,display_description='',display_name='d2b89aae-be9a-430f-bbdb-ab82a4eaa161-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b72fbc-4bd1-44b5-b61e-df149c062805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29ad6746587417394a78d2aea225db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:41Z,use_quota=True,user_id='94091757171949b5b66dbb67cd0c3db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552ed079-630b-4e7c-be20-a37f49b9e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552ed079-630b-4e7c-be20-a37f49b9e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708f60a-f2e8-4a4c-a2b3-8d367b89cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708f60a-f2e8-4a4c-a2b3-8d367b89cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b72fbc-4bd1-44b5-b61e-df149c062805', 'volume_name': 'volume-f6b72fbc-4bd1-44b5-b61e-df149c062805', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b6073-7530-4f2f-a864-c49ba6668885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b6073-7530-4f2f-a864-c49ba6668885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0997acd7-24e7-42fb-b326-833a4ced81e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume f6b72fbc-4bd1-44b5-b61e-df149c062805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b72fbc-4bd1-44b5-b61e-df149c062805', 'volume_size': 1}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:41Z,deleted=False,deleted_at=None,display_description='',display_name='d2b89aae-be9a-430f-bbdb-ab82a4eaa161-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b72fbc-4bd1-44b5-b61e-df149c062805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29ad6746587417394a78d2aea225db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:41Z,use_quota=True,user_id='94091757171949b5b66dbb67cd0c3db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Creating volume f6b72fbc-4bd1-44b5-b61e-df149c062805 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:41 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:41 devstack sudo[84742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 1073741824
Apr 24 01:09:41 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22196ee1-9893-45c7-b0fa-dcdc075a4db6 tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-746586949: creating
Apr 24 01:09:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22196ee1-9893-45c7-b0fa-dcdc075a4db6 tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-746586949: created successfully
Apr 24 01:09:42 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22196ee1-9893-45c7-b0fa-dcdc075a4db6 tempest-GroupSnapshotsTest-1716991509 None] Create group completed successfully.
Apr 24 01:09:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 1073741824" returned: 0 in 1.091s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:42 devstack sudo[84749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805
Apr 24 01:09:42 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:43 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805" returned: 0 in 0.680s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0997acd7-24e7-42fb-b326-833a4ced81e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b72fbc-4bd1-44b5-b61e-df149c062805', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24639782-5a52-4648-b721-0d6d86e21efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 (f6b72fbc-4bd1-44b5-b61e-df149c062805): created successfully
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24639782-5a52-4648-b721-0d6d86e21efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Flow 'volume_create_manager' (8b43b7c6-86ef-4eea-9871-84e5f0f8b52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-721bc160-233f-4fd3-9bb3-a255d8f5807f tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Created volume successfully.
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (d1bfef39-64bb-4f92-bca7-3074c74088b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bc3ca9-e4c9-48db-be1c-d0df6b502176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bc3ca9-e4c9-48db-be1c-d0df6b502176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1605581860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ecef647-30c5-4975-b330-78982f2226fc,host='devstack@QuobyteHD#QuobyteHD',id=35d1fca6-49a0-4cc8-be95-180723fd8be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:44Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b331c0-29bc-4f7c-a2c9-d7298f232e83),volume_type_id=72b331c0-29bc-4f7c-a2c9-d7298f232e83)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b14296-55b9-4f4a-859b-ed09c37a13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b14296-55b9-4f4a-859b-ed09c37a13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d47e6d-2fdf-4c5c-91d3-0780bfda47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d47e6d-2fdf-4c5c-91d3-0780bfda47ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d1fca6-49a0-4cc8-be95-180723fd8be1', 'volume_name': 'volume-35d1fca6-49a0-4cc8-be95-180723fd8be1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b1708-3b39-41c5-b584-584d0301d7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b1708-3b39-41c5-b584-584d0301d7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086ab987-332b-4094-b73f-adfcc0eea135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Volume 35d1fca6-49a0-4cc8-be95-180723fd8be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d1fca6-49a0-4cc8-be95-180723fd8be1', 'volume_size': 1}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8ecef647-30c5-4975-b330-78982f2226fc,created_at=2026-04-23T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1605581860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ecef647-30c5-4975-b330-78982f2226fc,host='devstack@QuobyteHD#QuobyteHD',id=35d1fca6-49a0-4cc8-be95-180723fd8be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:44Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b331c0-29bc-4f7c-a2c9-d7298f232e83),volume_type_id=72b331c0-29bc-4f7c-a2c9-d7298f232e83)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Creating volume 35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:44 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:44 devstack sudo[84757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 1073741824
Apr 24 01:09:44 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:45 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 1073741824" returned: 0 in 0.901s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:45 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:09:45 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:45 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.729s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.132s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb705928-0b44-4246-b450-d8fbd01127ec]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086ab987-332b-4094-b73f-adfcc0eea135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d1fca6-49a0-4cc8-be95-180723fd8be1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5460e714-f040-425c-93e7-27bb98d18682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:46 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Volume volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 (35d1fca6-49a0-4cc8-be95-180723fd8be1): created successfully
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5460e714-f040-425c-93e7-27bb98d18682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (d1bfef39-64bb-4f92-bca7-3074c74088b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:46 devstack sudo[84787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805
Apr 24 01:09:46 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:46 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8ccaf6f8-2ce7-416a-bc36-0aeaf27777f7 tempest-GroupSnapshotsTest-1716991509 None] Created volume successfully.
Apr 24 01:09:46 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805" returned: 0 in 0.954s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=108,cinder:SELECT=80,cinder:INSERT=24,cinder:DELETE=8 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:09:46 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=114,cinder:SELECT=93,cinder:INSERT=28,cinder:DELETE=8 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054', 'name': 'volume-f6b72fbc-4bd1-44b5-b61e-df149c062805', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c53e3b95-8edb-44c6-8462-86b4089e486d', 'enforce_multipath': True} {{(pid=81902) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 01:09:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] GroupSnapshot 9fc1adcb-83a2-4861-9fff-20678915d689: creating.
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Group snapshot 9fc1adcb-83a2-4861-9fff-20678915d689: creating. {{(pid=81902) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 01:09:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-46b0d801-994b-45f8-bf93-f47ece002817 req-a67ba4e1-4128-46a8-a045-674b590c74a3 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] attachment_update completed successfully.
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Creating offline snapshot a1aa4636-b5fa-42ba-82f1-72c10cc43da6 of volume 35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[85744581-8af0-4e29-95ca-9dac8663c766]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:47 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:09:47 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:48 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.911s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:48 devstack sudo[84832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 1G
Apr 24 01:09:48 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:49 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 1G" returned: 0 in 1.001s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:49 devstack sudo[84839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:09:49 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Flow 'volume_create_manager' (c4bdaaef-ccc6-486c-b6be-01529f141f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b926f87-92ac-4477-a708-d8365ad2c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:50 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b926f87-92ac-4477-a708-d8365ad2c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-262638725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5d2a7-5aa9-438e-964f-52224a912311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df90d1850d74d1e8b2d87ce72ff51d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:50Z,use_quota=True,user_id='6d45e8caf1934474867eb8f3acf69c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bdab22-ebd8-49ea-8eaf-d730d849fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bdab22-ebd8-49ea-8eaf-d730d849fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819ddfa2-8e60-4422-98a8-2a9282c5f091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819ddfa2-8e60-4422-98a8-2a9282c5f091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f5d2a7-5aa9-438e-964f-52224a912311', 'volume_name': 'volume-36f5d2a7-5aa9-438e-964f-52224a912311', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe872a-d8c9-4706-a0dc-e36f867c5941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe872a-d8c9-4706-a0dc-e36f867c5941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49022f31-ac25-4c7e-bcb9-5e9b1e9811f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:50 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Volume 36f5d2a7-5aa9-438e-964f-52224a912311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f5d2a7-5aa9-438e-964f-52224a912311', 'volume_size': 1}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 0.956s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:50 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:50 devstack sudo[84910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:09:50 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:50 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 0.534s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:50 devstack sudo[84917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info
Apr 24 01:09:50 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:51 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info" returned: 0 in 0.565s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:51 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:09:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:51 devstack sudo[84930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info
Apr 24 01:09:51 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:52 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.info" returned: 0 in 0.714s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.807s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-262638725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5d2a7-5aa9-438e-964f-52224a912311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df90d1850d74d1e8b2d87ce72ff51d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:50Z,use_quota=True,user_id='6d45e8caf1934474867eb8f3acf69c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Creating volume 36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:52 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:52 devstack sudo[84958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 1073741824
Apr 24 01:09:52 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7cc6cc21-446d-463f-8c8f-edc15d2a9f49 tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 9fc1adcb-83a2-4861-9fff-20678915d689: created successfully
Apr 24 01:09:52 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 1073741824" returned: 0 in 0.816s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:52 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311
Apr 24 01:09:52 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:53 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311" returned: 0 in 0.939s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:09:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49022f31-ac25-4c7e-bcb9-5e9b1e9811f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f5d2a7-5aa9-438e-964f-52224a912311', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1dfb4e-e331-44ed-a7e9-011e92e1829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:09:54 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Volume volume-36f5d2a7-5aa9-438e-964f-52224a912311 (36f5d2a7-5aa9-438e-964f-52224a912311): created successfully
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1dfb4e-e331-44ed-a7e9-011e92e1829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Flow 'volume_create_manager' (c4bdaaef-ccc6-486c-b6be-01529f141f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-aa144c67-80cb-49ff-92f7-37cd666ec84c tempest-SnapshotMetadataTestJSON-1004685993 None] Created volume successfully.
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Creating volume ddf07c65-1f19-452f-8b13-1ea7f98b8c52 from snapshot a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] snapshot: a1aa4636-b5fa-42ba-82f1-72c10cc43da6, volume: ddf07c65-1f19-452f-8b13-1ea7f98b8c52,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb6ff5-a2a6-4877-8a90-9b9012e1ef4a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:54 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:09:54 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:09:55 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 1.099s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d1fca6-49a0-4cc8-be95-180723fd8be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf7316-d3e9-4996-adfb-3bfd175609d1]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:55 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:09:55 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:09:55 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.619s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:09:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:09:55 devstack sudo[85345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52
Apr 24 01:09:55 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Flow 'volume_create_manager' (764d0d5c-e62c-4c5d-b8a9-29bb620bb8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7129ad54-08fa-475e-8772-eed8e9a435ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7129ad54-08fa-475e-8772-eed8e9a435ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1549499027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970dee5439b457d9e3aac1f4f9d9056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:00Z,use_quota=True,user_id='dc6ea98f074544fabc0ad6c1aac56fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b48e0e-9bf1-41f4-b80f-1f8557a4ba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b48e0e-9bf1-41f4-b80f-1f8557a4ba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2455c1b2-dd13-4002-929a-e94a4c6dde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2455c1b2-dd13-4002-929a-e94a4c6dde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c', 'volume_name': 'volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eb3e0e-40b0-4c8a-902f-88db16120833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eb3e0e-40b0-4c8a-902f-88db16120833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c341f1df-6a7a-4878-b56d-224a52dec1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:00 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Volume f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c', 'volume_size': 1}
Apr 24 01:10:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:02 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" returned: 0 in 6.781s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:02 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3879fa51-8151-4f20-89ac-0db09a3dd9a8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:02 devstack sudo[85375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:10:02 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:03 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.708s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:10:03 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Converted 1024.00 MB image at 150.98 MB/s
Apr 24 01:10:03 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:03 devstack sudo[85380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52
Apr 24 01:10:03 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:03 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" returned: 0 in 0.477s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" released by "_copy_volume_from_snapshot" :: held 9.828s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" released by "_create_volume_from_snapshot" :: held 9.909s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.936s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.288s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Creating offline snapshot e755b833-9dc6-478b-b184-b82c864c3c4a of volume 36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bab602a-3cf5-4e0a-9259-a06c95019918]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:04 devstack sudo[85383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311
Apr 24 01:10:04 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:04 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311" returned: 0 in 0.570s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:04 devstack sudo[85388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a 1G
Apr 24 01:10:04 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:05 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a 1G" returned: 0 in 0.649s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5d2a7-5aa9-438e-964f-52224a912311 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:05 devstack sudo[85393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5d2a7-5aa9-438e-964f-52224a912311 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a
Apr 24 01:10:05 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:05 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5d2a7-5aa9-438e-964f-52224a912311 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a" returned: 0 in 0.648s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:05 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a is being set with open permissions: ugo+rw
Apr 24 01:10:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:05 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a
Apr 24 01:10:05 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:06 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a" returned: 0 in 0.584s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:06 devstack sudo[85424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info
Apr 24 01:10:06 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f5492d79-19a3-4eb6-a0d7-7968b843ccbe tempest-GroupSnapshotsTest-1716991509 None] Create group from source-snapshot-9fc1adcb-83a2-4861-9fff-20678915d689 completed successfully.
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" acquired by "delete_volume" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a6013-0945-43bd-90c0-af331c070953]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:07 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info" returned: 0 in 0.811s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:07 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info is being set with open permissions: ugo+rw
Apr 24 01:10:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:07 devstack sudo[85436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info
Apr 24 01:10:07 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:07 devstack sudo[85435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52
Apr 24 01:10:07 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:08 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" returned: 0 in 0.787s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:08 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:08 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52
Apr 24 01:10:08 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.info" returned: 0 in 0.774s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.956s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1549499027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970dee5439b457d9e3aac1f4f9d9056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:00Z,use_quota=True,user_id='dc6ea98f074544fabc0ad6c1aac56fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Creating volume f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:10:08 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:10:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9b4086e9-f3b3-443e-94c9-e46649bfb4a4 tempest-SnapshotMetadataTestJSON-1004685993 None] Create snapshot completed successfully
Apr 24 01:10:08 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c 1073741824
Apr 24 01:10:08 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:09 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" returned: 0 in 0.756s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-ddf07c65-1f19-452f-8b13-1ea7f98b8c52" released by "delete_volume" :: held 1.631s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['b0d1d3be-ca3d-4e04-b697-a9f542d3d336'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:09 devstack cinder-volume[81902]: WARNING cinder.quota [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-698415203 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-698415203, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:09 devstack cinder-volume[81902]: WARNING cinder.quota [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-698415203 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-698415203, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['79d3f6a7-7b25-45c8-93c8-11f4c32757e5', '0650730b-bd3c-4283-9196-843ce52b54f1', '9d6d7f3c-68e6-4c28-a214-5100d0c4a439', '5ccb710c-530e-441f-918c-e484ff99dddf'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:09 devstack sudo[85496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:09 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:09 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c 1073741824" returned: 0 in 1.118s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:09 devstack sudo[85498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c
Apr 24 01:10:09 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:09 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 9fc1adcb-83a2-4861-9fff-20678915d689: deleting
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 9fc1adcb-83a2-4861-9fff-20678915d689: deleting {{(pid=81902) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 01:10:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Deleting offline snapshot a1aa4636-b5fa-42ba-82f1-72c10cc43da6 of volume 35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] snapshot_file for this snap is: volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdec4d9-8ce4-4900-9286-88be7fbf323f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:10 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.700s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:10 devstack sudo[85501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:10:10 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4b5f5fae-7d53-4165-b5cc-a5b67fcffa4e tempest-GroupSnapshotsTest-1716991509 None] Delete group completed successfully.
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "cinder-e755b833-9dc6-478b-b184-b82c864c3c4a-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-e755b833-9dc6-478b-b184-b82c864c3c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "cinder-quobyte-e755b833-9dc6-478b-b184-b82c864c3c4a" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-e755b833-9dc6-478b-b184-b82c864c3c4a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Deleting offline snapshot e755b833-9dc6-478b-b184-b82c864c3c4a of volume 36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] snapshot_file for this snap is: volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe5209b-5677-4433-9372-58726fb52799]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:10 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" returned: 0 in 0.790s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c341f1df-6a7a-4878-b56d-224a52dec1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71633909-9cb0-4c40-8bb8-413ed28f5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Volume volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c (f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c): created successfully
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71633909-9cb0-4c40-8bb8-413ed28f5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Flow 'volume_create_manager' (764d0d5c-e62c-4c5d-b8a9-29bb620bb8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:10 devstack sudo[85504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a
Apr 24 01:10:10 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f470101e-420a-40cb-9051-e6cc8a61d34c tempest-ServersNegativeTestJSON-157569944 None] Created volume successfully.
Apr 24 01:10:10 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 0.732s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d1fca6-49a0-4cc8-be95-180723fd8be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af1e7a-efa2-41f4-9c9d-38b0ca9791b1]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:10 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:10:10 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:11 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a" returned: 0 in 0.698s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f5d2a7-5aa9-438e-964f-52224a912311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[08071154-8f04-4d36-868f-86b6ccf2d0f7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:11 devstack sudo[85516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311
Apr 24 01:10:11 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:11 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.666s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:11 devstack sudo[85521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:10:11 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:11 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:11 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a
Apr 24 01:10:11 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:12 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 0.686s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:12 devstack sudo[85533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6
Apr 24 01:10:12 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Flow 'volume_create_manager' (a6bfce37-839f-4461-8f57-3b0964586874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979d1d9d-aa36-46c6-99cd-addedbb107f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979d1d9d-aa36-46c6-99cd-addedbb107f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1109291402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db1d34-2654-44bc-9dd9-e2543e40d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970dee5439b457d9e3aac1f4f9d9056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:12Z,use_quota=True,user_id='dc6ea98f074544fabc0ad6c1aac56fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1002e9f0-b31a-4415-af2f-4a48d4dd253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1002e9f0-b31a-4415-af2f-4a48d4dd253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5203e-bfef-4ddc-8846-7d8481a5585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5203e-bfef-4ddc-8846-7d8481a5585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91db1d34-2654-44bc-9dd9-e2543e40d69b', 'volume_name': 'volume-91db1d34-2654-44bc-9dd9-e2543e40d69b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaddb33-db53-4eaa-85be-fbe8616ab013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaddb33-db53-4eaa-85be-fbe8616ab013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f91678-9a55-4214-aa75-25698078c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Volume 91db1d34-2654-44bc-9dd9-e2543e40d69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91db1d34-2654-44bc-9dd9-e2543e40d69b', 'volume_size': 1}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1109291402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db1d34-2654-44bc-9dd9-e2543e40d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970dee5439b457d9e3aac1f4f9d9056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:12Z,use_quota=True,user_id='dc6ea98f074544fabc0ad6c1aac56fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Creating volume 91db1d34-2654-44bc-9dd9-e2543e40d69b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:10:12 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:12 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a" returned: 0 in 0.744s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:12 devstack sudo[85539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b 1073741824
Apr 24 01:10:12 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:12 devstack sudo[85540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a
Apr 24 01:10:12 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:12 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1.a1aa4636-b5fa-42ba-82f1-72c10cc43da6" returned: 0 in 0.593s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-a1aa4636-b5fa-42ba-82f1-72c10cc43da6" released by "_delete_snapshot" :: held 2.790s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" released by "delete_snapshot" :: held 2.824s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:12 devstack cinder-volume[81902]: WARNING cinder.quota [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-698415203 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-698415203, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:12 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['565ed674-d745-4f54-a1d3-fa34c83e24a2', '2aac4b9d-6ae6-4876-8efb-da610f863ceb', '5507dec9-e8c7-4025-bbe4-9750171e9dea', '20340c67-d6af-46ed-82b8-74cf43658d69'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c368464d-0274-41ac-bf61-90f2c6ab217f tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 9fc1adcb-83a2-4861-9fff-20678915d689: deleted successfully
Apr 24 01:10:13 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311.e755b833-9dc6-478b-b184-b82c864c3c4a" returned: 0 in 0.699s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-e755b833-9dc6-478b-b184-b82c864c3c4a" released by "_delete_snapshot" :: held 2.999s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" released by "delete_snapshot" :: held 3.026s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:13 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b 1073741824" returned: 0 in 0.789s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Created reservations ['e53cfb80-4e65-49bc-9d9d-d6f8a6397926', 'ed0f3fb3-1ee4-4b8e-8d75-60e173150cf2', '50588d15-f741-45a7-b2a4-52a35ff76b79', '92b6c064-2889-402d-aba7-37d27dddde3a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:13 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b
Apr 24 01:10:13 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Delete snapshot completed successfully.
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef6d6a53-025a-4c62-9f52-85cdd2fca085 tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-e755b833-9dc6-478b-b184-b82c864c3c4a-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9d03e-9169-43ec-947d-d7c74ba864c8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:13 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:10:13 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:14 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b" returned: 0 in 0.702s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f91678-9a55-4214-aa75-25698078c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91db1d34-2654-44bc-9dd9-e2543e40d69b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affe2ce2-bfa6-4041-b756-a788114d02d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:14 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Volume volume-91db1d34-2654-44bc-9dd9-e2543e40d69b (91db1d34-2654-44bc-9dd9-e2543e40d69b): created successfully
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affe2ce2-bfa6-4041-b756-a788114d02d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Flow 'volume_create_manager' (a6bfce37-839f-4461-8f57-3b0964586874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:14 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ce6899c5-49ba-491d-a74e-3c7a156e10d9 tempest-ServersNegativeTestJSON-157569944 None] Created volume successfully.
Apr 24 01:10:14 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.630s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:14 devstack sudo[85570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1
Apr 24 01:10:14 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "cinder-36f5d2a7-5aa9-438e-964f-52224a912311-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-36f5d2a7-5aa9-438e-964f-52224a912311-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" acquired by "delete_volume" :: waited 0.071s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea452dc-b82c-40eb-83f3-63e3a321c7c5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:15 devstack sudo[85592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311
Apr 24 01:10:15 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:15 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-35d1fca6-49a0-4cc8-be95-180723fd8be1" returned: 0 in 0.881s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-35d1fca6-49a0-4cc8-be95-180723fd8be1" released by "delete_volume" :: held 1.629s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "cinder-91db1d34-2654-44bc-9dd9-e2543e40d69b-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-91db1d34-2654-44bc-9dd9-e2543e40d69b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['a29ff843-434c-490d-b4a6-f990e0ba7c87'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "cinder-quobyte-91db1d34-2654-44bc-9dd9-e2543e40d69b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-quobyte-91db1d34-2654-44bc-9dd9-e2543e40d69b" acquired by "delete_volume" :: waited 0.055s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:15 devstack cinder-volume[81902]: WARNING cinder.db.sqlalchemy.api [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-698415203']
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad28d95-f6a6-4b2e-a574-9cf6d069e03e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:15 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['2daf91fb-6c13-4e81-a409-6d1ad9985087', 'eb1a2811-bc44-41e4-b39b-f3b447e4aeeb', '2d087e8e-5611-4a74-ae9a-8a38e6492bcd', 'a83fe9d9-ec55-4b1e-b087-ac945b2ef2cb'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:15 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311" returned: 0 in 0.948s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:16 devstack sudo[85611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311
Apr 24 01:10:16 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:16 devstack sudo[85610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b
Apr 24 01:10:16 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:16 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:16 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:16 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b" returned: 0 in 1.055s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:16 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-36f5d2a7-5aa9-438e-964f-52224a912311" returned: 0 in 0.867s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-quobyte-36f5d2a7-5aa9-438e-964f-52224a912311" released by "delete_volume" :: held 1.930s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:16 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b
Apr 24 01:10:16 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:17 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Created reservations ['6efc5bcc-f6eb-4a9e-9e0c-4d3d4677fc2b', '3a502f77-7f3c-4e0b-af2b-4f9b327acf75', '47f72c39-b3f6-44cd-b402-9fd78131b258', '069e1f2a-b360-4983-a9ba-9933fcaa25c5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.699s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2caebba3-6316-47d3-931d-35cb2cf727da tempest-GroupSnapshotsTest-1716991509 None] Delete group completed successfully.
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:17 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:17 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:17 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-91db1d34-2654-44bc-9dd9-e2543e40d69b" returned: 0 in 0.900s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-quobyte-91db1d34-2654-44bc-9dd9-e2543e40d69b" released by "delete_volume" :: held 2.082s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Created reservations ['2f0fd81b-def9-4690-bffc-4da0ea2b8f9d', '141565a5-f7ba-4eaa-b14b-9d1133e186f2', '5a1ea7c8-b96a-45d2-8f0c-9ff65fba403a', '777fb047-5096-42e3-b0f8-db7d159d69b9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:18 devstack sudo[85632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:18 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:18 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.263s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Deleted volume successfully.
Apr 24 01:10:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b3ca3422-0efe-46ba-a959-024c3beb0488 tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-672725031: creating
Apr 24 01:10:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7ed19fdc-2cac-4335-8a8c-95fa2e11cdbf tempest-SnapshotMetadataTestJSON-1004685993 None] Lock "cinder-36f5d2a7-5aa9-438e-964f-52224a912311-delete_volume" released by "delete_volume" :: held 3.633s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b3ca3422-0efe-46ba-a959-024c3beb0488 tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-672725031: created successfully
Apr 24 01:10:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b3ca3422-0efe-46ba-a959-024c3beb0488 tempest-GroupSnapshotsTest-1716991509 None] Create group completed successfully.
Apr 24 01:10:19 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.793s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:19 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Deleted volume successfully.
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d2097adb-4311-44b6-bb12-866d5edea790 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-91db1d34-2654-44bc-9dd9-e2543e40d69b-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "cinder-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "cinder-quobyte-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-quobyte-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3ab394-19d8-4cfe-a2ee-eb238e66c179]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:19 devstack sudo[85636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:19 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:19 devstack sudo[85635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c
Apr 24 01:10:19 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (b3caabe2-df4e-478b-99ea-0d6152ef0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87eb330-7830-4219-95c0-3a930d542a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87eb330-7830-4219-95c0-3a930d542a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000618545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,host='devstack@QuobyteHD#QuobyteHD',id=506d2342-1355-47f5-a17d-af8f51756689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:20Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1af6c409-b314-44ec-8a7d-919d4a25222f),volume_type_id=1af6c409-b314-44ec-8a7d-919d4a25222f)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e86b474-863e-4cfb-91ca-89eddab4e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e86b474-863e-4cfb-91ca-89eddab4e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f65bb-1f64-4037-a657-9dc202a6b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f65bb-1f64-4037-a657-9dc202a6b94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506d2342-1355-47f5-a17d-af8f51756689', 'volume_name': 'volume-506d2342-1355-47f5-a17d-af8f51756689', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc25314-085e-46a3-ac38-e56cf05bc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc25314-085e-46a3-ac38-e56cf05bc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ac1d3-ef5a-4346-b3bd-dd0bad7d11ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Volume 506d2342-1355-47f5-a17d-af8f51756689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506d2342-1355-47f5-a17d-af8f51756689', 'volume_size': 1}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,created_at=2026-04-23T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000618545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,host='devstack@QuobyteHD#QuobyteHD',id=506d2342-1355-47f5-a17d-af8f51756689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:20Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1af6c409-b314-44ec-8a7d-919d4a25222f),volume_type_id=1af6c409-b314-44ec-8a7d-919d4a25222f)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Creating volume 506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:10:20 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:20 devstack sudo[85641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 1073741824
Apr 24 01:10:20 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:20 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.349s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:20 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" returned: 0 in 1.511s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:20 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c
Apr 24 01:10:20 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:21 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 1073741824" returned: 0 in 1.160s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:21 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" returned: 0 in 1.076s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:21 devstack sudo[85660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689
Apr 24 01:10:21 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-quobyte-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c" released by "delete_volume" :: held 2.655s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Created reservations ['29238dfc-20d3-42f4-9103-83148369fb92', 'e34340b3-c697-4048-b707-964bbd6e29ab', '46b78fb4-6661-4a3e-aed7-307ae9b50267', 'c53dd5e2-2d98-4452-8313-6e8732355338'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:22 devstack sudo[85665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:22 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:22 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689" returned: 0 in 0.972s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ac1d3-ef5a-4346-b3bd-dd0bad7d11ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506d2342-1355-47f5-a17d-af8f51756689', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:22 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b81f2b3-6af4-4b74-9b8c-ded542ada2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.694s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:22 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Deleted volume successfully.
Apr 24 01:10:22 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Volume volume-506d2342-1355-47f5-a17d-af8f51756689 (506d2342-1355-47f5-a17d-af8f51756689): created successfully
Apr 24 01:10:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b81f2b3-6af4-4b74-9b8c-ded542ada2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (b3caabe2-df4e-478b-99ea-0d6152ef0354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6026f340-5244-49c3-8f08-5eee7b325910 tempest-GroupSnapshotsTest-1716991509 None] Created volume successfully.
Apr 24 01:10:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0dfb8f53-c971-40ec-9113-7c3924b4b3c1 tempest-ServersNegativeTestJSON-157569944 None] Lock "cinder-f6f89ffa-fcf4-4c26-81e0-d38d63c3b77c-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (c2dac020-39b6-489d-b124-8e312d74bc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce670b71-8954-4893-8b74-f8a67c3975cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce670b71-8954-4893-8b74-f8a67c3975cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324247596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,host='devstack@QuobyteHD#QuobyteHD',id=144f3989-9e37-4f0a-a88f-5189cdebafbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:25Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1af6c409-b314-44ec-8a7d-919d4a25222f),volume_type_id=1af6c409-b314-44ec-8a7d-919d4a25222f)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c9524-066c-44c4-9204-53c8b895b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c9524-066c-44c4-9204-53c8b895b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6597c4f3-f42c-4f9e-9f4c-97e085062f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6597c4f3-f42c-4f9e-9f4c-97e085062f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144f3989-9e37-4f0a-a88f-5189cdebafbf', 'volume_name': 'volume-144f3989-9e37-4f0a-a88f-5189cdebafbf', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c4711b-d3b5-42bb-af5d-ddadb4b3f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c4711b-d3b5-42bb-af5d-ddadb4b3f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5d110f-9e2c-4adc-b77e-856adc2103d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Volume 144f3989-9e37-4f0a-a88f-5189cdebafbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144f3989-9e37-4f0a-a88f-5189cdebafbf', 'volume_size': 1}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,created_at=2026-04-23T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324247596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e06e0be-6973-4fbe-a532-68f3ebc38190,host='devstack@QuobyteHD#QuobyteHD',id=144f3989-9e37-4f0a-a88f-5189cdebafbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:25Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1af6c409-b314-44ec-8a7d-919d4a25222f),volume_type_id=1af6c409-b314-44ec-8a7d-919d4a25222f)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Creating volume 144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:10:25 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:10:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:25 devstack sudo[85753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf 1073741824
Apr 24 01:10:25 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:26 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf 1073741824" returned: 0 in 1.241s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:26 devstack sudo[85776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf
Apr 24 01:10:26 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:27 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf" returned: 0 in 0.894s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5d110f-9e2c-4adc-b77e-856adc2103d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144f3989-9e37-4f0a-a88f-5189cdebafbf', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcff3b0e-c6be-45aa-a064-095a80df075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:27 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Volume volume-144f3989-9e37-4f0a-a88f-5189cdebafbf (144f3989-9e37-4f0a-a88f-5189cdebafbf): created successfully
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcff3b0e-c6be-45aa-a064-095a80df075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (c2dac020-39b6-489d-b124-8e312d74bc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9fcaf6bd-01bd-49f3-9004-ad5b8a286350 tempest-GroupSnapshotsTest-1716991509 None] Created volume successfully.
Apr 24 01:10:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a13f7b1c-6059-4e7f-99fa-0ac6d7f85c5a tempest-GroupSnapshotsTest-1716991509 None] Update group completed successfully.
Apr 24 01:10:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-522107a4-5573-4e4a-9fff-64246077beb8 tempest-GroupSnapshotsTest-1716991509 None] Update group completed successfully.
Apr 24 01:10:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e13f5eca-2bd9-4666-b928-e1683097aaf3 tempest-GroupSnapshotsTest-1716991509 None] Update group completed successfully.
Apr 24 01:10:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0a1cd284-5991-4166-b465-afe959913ddf tempest-GroupSnapshotsTest-1716991509 None] Update group completed successfully.
Apr 24 01:10:33 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] GroupSnapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: creating.
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Group snapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: creating. {{(pid=81902) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Creating offline snapshot 4499e860-6f7c-4618-a700-1020a2ee3270 of volume 506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[160bf21e-7dd3-426a-ba48-e1b1e59086ed]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:34 devstack sudo[85826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689
Apr 24 01:10:34 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:34 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689" returned: 0 in 0.807s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:34 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 1G
Apr 24 01:10:34 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:35 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 1G" returned: 0 in 0.955s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506d2342-1355-47f5-a17d-af8f51756689 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:35 devstack sudo[85852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506d2342-1355-47f5-a17d-af8f51756689 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270
Apr 24 01:10:35 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:36 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506d2342-1355-47f5-a17d-af8f51756689 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270" returned: 0 in 0.831s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:36 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:10:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:36 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270
Apr 24 01:10:36 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:37 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270" returned: 0 in 0.720s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:37 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info
Apr 24 01:10:37 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Flow 'volume_create_manager' (e0d8571c-97ce-4016-bd3c-9e4a06dd6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d3ebe-42d0-4d31-966d-92414b4a979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d3ebe-42d0-4d31-966d-92414b4a979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368743900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b443b347-346c-4452-9808-d224590ae597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5992878c4354859bb1d5c1bb431478d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:38Z,use_quota=True,user_id='b0ad030bbc7e4729b28013c154fa985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d591ca7-3f5c-45ad-a317-9b7f3330adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d591ca7-3f5c-45ad-a317-9b7f3330adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bf233b-536a-40dd-b7ce-f630fa18ae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bf233b-536a-40dd-b7ce-f630fa18ae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b443b347-346c-4452-9808-d224590ae597', 'volume_name': 'volume-b443b347-346c-4452-9808-d224590ae597', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f5eda8-1a52-454a-bef0-368a757322e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f5eda8-1a52-454a-bef0-368a757322e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd27e3a-683c-4938-9693-12eaf812c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:37 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Volume b443b347-346c-4452-9808-d224590ae597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b443b347-346c-4452-9808-d224590ae597', 'volume_size': 1}
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:37 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:37 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:10:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:38 devstack sudo[85863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info
Apr 24 01:10:38 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:38 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.info" returned: 0 in 0.578s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.719s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Creating offline snapshot cb005232-866f-461f-a3f3-d28ac874ea97 of volume 144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[18042e84-993d-4dc3-9bab-74b3319bf8e4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:38 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf
Apr 24 01:10:38 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:39 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf" returned: 0 in 0.887s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:39 devstack sudo[85873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 1G
Apr 24 01:10:39 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:40 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 1G" returned: 0 in 0.799s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f3989-9e37-4f0a-a88f-5189cdebafbf -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:40 devstack sudo[85879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f3989-9e37-4f0a-a88f-5189cdebafbf -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97
Apr 24 01:10:40 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:40 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f3989-9e37-4f0a-a88f-5189cdebafbf -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97" returned: 0 in 0.549s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:40 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:10:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:40 devstack sudo[85884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97
Apr 24 01:10:40 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:41 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97" returned: 0 in 0.449s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:41 devstack sudo[85887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info
Apr 24 01:10:41 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:41 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info" returned: 0 in 0.587s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:41 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:10:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:42 devstack sudo[85890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info
Apr 24 01:10:42 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:42 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.info" returned: 0 in 0.566s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.989s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.780s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368743900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b443b347-346c-4452-9808-d224590ae597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5992878c4354859bb1d5c1bb431478d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:38Z,use_quota=True,user_id='b0ad030bbc7e4729b28013c154fa985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Creating volume b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:10:42 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:10:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:42 devstack sudo[85894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 1073741824
Apr 24 01:10:42 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-43525230-1638-4e3b-95a7-68cb0a67b98a tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: created successfully
Apr 24 01:10:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: deleting
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: deleting {{(pid=81902) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 01:10:43 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 1073741824" returned: 0 in 0.949s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-4499e860-6f7c-4618-a700-1020a2ee3270" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-4499e860-6f7c-4618-a700-1020a2ee3270" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Deleting offline snapshot 4499e860-6f7c-4618-a700-1020a2ee3270 of volume 506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:10:43 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:10:43 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] snapshot_file for this snap is: volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb644444-d3b1-4a9c-9bde-10450f4e3e63]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:43 devstack sudo[85905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270
Apr 24 01:10:43 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:44 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.569s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd27e3a-683c-4938-9693-12eaf812c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b443b347-346c-4452-9808-d224590ae597', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acca0c0d-b420-4291-a786-7b1f16266d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:10:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Volume volume-b443b347-346c-4452-9808-d224590ae597 (b443b347-346c-4452-9808-d224590ae597): created successfully
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acca0c0d-b420-4291-a786-7b1f16266d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Flow 'volume_create_manager' (e0d8571c-97ce-4016-bd3c-9e4a06dd6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:10:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1998af21-36aa-4203-a646-154babd28e7c tempest-VolumesActionsTest-766264414 None] Created volume successfully.
Apr 24 01:10:44 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270" returned: 0 in 0.730s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506d2342-1355-47f5-a17d-af8f51756689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd3ac28-7858-4322-8fa7-b917de846154]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:44 devstack sudo[85911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689
Apr 24 01:10:44 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:45 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689" returned: 0 in 0.626s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:45 devstack sudo[85922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270
Apr 24 01:10:45 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:45 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270" returned: 0 in 0.870s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:46 devstack sudo[85950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270
Apr 24 01:10:46 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:46 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689.4499e860-6f7c-4618-a700-1020a2ee3270" returned: 0 in 0.780s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-4499e860-6f7c-4618-a700-1020a2ee3270" released by "_delete_snapshot" :: held 3.164s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" released by "delete_snapshot" :: held 3.213s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" acquired by "delete_snapshot" :: waited 0.065s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-cb005232-866f-461f-a3f3-d28ac874ea97" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-cb005232-866f-461f-a3f3-d28ac874ea97" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Deleting offline snapshot cb005232-866f-461f-a3f3-d28ac874ea97 of volume 144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:10:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] snapshot_file for this snap is: volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:10:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa376d6c-90bc-4424-8bfd-071b649076ea]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:47 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97
Apr 24 01:10:47 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:48 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97" returned: 0 in 1.135s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-144f3989-9e37-4f0a-a88f-5189cdebafbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:10:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0bb6f4-6074-4a4b-bf6d-ac50d3dc928b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:48 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf
Apr 24 01:10:48 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:49 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf" returned: 0 in 1.105s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:49 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97
Apr 24 01:10:49 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:50 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97" returned: 0 in 1.036s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:50 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97
Apr 24 01:10:50 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:51 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf.cb005232-866f-461f-a3f3-d28ac874ea97" returned: 0 in 0.659s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-cb005232-866f-461f-a3f3-d28ac874ea97" released by "_delete_snapshot" :: held 4.153s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" released by "delete_snapshot" :: held 4.226s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=96,cinder:UPDATE=105,cinder:DELETE=6,cinder:INSERT=19 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=96,cinder:UPDATE=77,cinder:INSERT=21,cinder:DELETE=4 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:10:51 devstack cinder-volume[81902]: WARNING cinder.quota [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1697166262 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1697166262, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:51 devstack cinder-volume[81902]: WARNING cinder.quota [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1697166262 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1697166262, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['218aac01-9f14-4977-adbf-464d7279d3c0', '77177c7c-8f41-4ed0-a11c-5a431abfeebf', '3b1c4604-a7f2-4171-a78f-b9729a04c8f8', '22c3e8f1-314f-4387-8b30-7ff7908b6709'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:51 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['03dacde4-4205-4f36-ae6f-4fb4160114ca', '620bf0f2-675a-403a-a16e-2ff24e78499d', '985d5e74-6817-4ae9-aec9-708df989b076', '5a28e276-c923-47d7-b171-7c4b81f341a5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-35edb655-3c38-475a-a6cc-27e57f7a9e52 tempest-GroupSnapshotsTest-1716991509 None] group_snapshot 2e1b74eb-0f20-4e72-8f8d-f332319d7175: deleted successfully
Apr 24 01:10:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" acquired by "delete_volume" :: waited 0.075s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:53 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c90551b-78f7-4921-a989-4cb22f07bf7f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:53 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf
Apr 24 01:10:53 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:54 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf" returned: 0 in 1.512s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:54 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf
Apr 24 01:10:54 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:55 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-144f3989-9e37-4f0a-a88f-5189cdebafbf" returned: 0 in 1.066s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-144f3989-9e37-4f0a-a88f-5189cdebafbf" released by "delete_volume" :: held 2.837s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" acquired by "delete_volume" :: waited 0.040s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6545986-8ef6-45c8-8028-61643ff7df2b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:10:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:56 devstack sudo[86051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689
Apr 24 01:10:56 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:57 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689" returned: 0 in 1.576s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:57 devstack sudo[86074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689
Apr 24 01:10:57 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:58 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-506d2342-1355-47f5-a17d-af8f51756689" returned: 0 in 0.687s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-506d2342-1355-47f5-a17d-af8f51756689" released by "delete_volume" :: held 2.401s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['71542e00-89f4-40d7-bfbc-f7252c616a22'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:58 devstack cinder-volume[81902]: WARNING cinder.quota [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1697166262 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1697166262, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['f9e3749b-4cd3-4ed5-8d10-8998559a1b7a', 'ac554d6d-89e8-408d-8f06-5d7ed2bc8b00', '7ca2b0df-45ad-4e29-a008-8b603e92d33a', 'bf24d2df-eebd-46cf-ab7e-8f51ec82de54'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['c5049dc4-c66b-4192-bcf7-6cd0dc3eff33', 'ad649f32-9ff1-4edb-a580-766746db1e41', '5868d753-f172-4d09-b999-672742fbf2e1', '88c839be-e740-4c3d-9574-7cf8fd9f651c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:10:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:10:58 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:10:58 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:10:59 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Apr 24 01:10:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.020s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:10:59 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:10:59 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a611537e-5ebb-426f-affb-35d7b732894c tempest-GroupSnapshotsTest-1716991509 None] Delete group completed successfully.
Apr 24 01:11:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-00d07aa8-dba0-4071-87d0-bc12829bc08f tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-343370387: creating
Apr 24 01:11:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-00d07aa8-dba0-4071-87d0-bc12829bc08f tempest-GroupSnapshotsTest-1716991509 None] Group tempest-GroupSnapshotsTest-Group-343370387: created successfully
Apr 24 01:11:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-00d07aa8-dba0-4071-87d0-bc12829bc08f tempest-GroupSnapshotsTest-1716991509 None] Create group completed successfully.
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Flow 'volume_create_manager' (879513a6-d78c-485d-bf88-5e3d6ba6c291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bba2c77-1401-428a-a051-b56bd60fbacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bba2c77-1401-428a-a051-b56bd60fbacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-915617701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26daee49-3883-4830-aaea-58374d01b895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87efe4cefc5494f98bdd3b507357789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:01Z,use_quota=True,user_id='1267149db3254496a8400fc6fe7a1635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70604cef-671c-42e9-a0aa-9cb2aa8c8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70604cef-671c-42e9-a0aa-9cb2aa8c8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d17a3-5ebe-456a-8691-f73a322bbbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d17a3-5ebe-456a-8691-f73a322bbbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26daee49-3883-4830-aaea-58374d01b895', 'volume_name': 'volume-26daee49-3883-4830-aaea-58374d01b895', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4693b517-036f-41df-96db-2f14e013e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4693b517-036f-41df-96db-2f14e013e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab71b3-8ad4-451f-a9c5-1ac999f35788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Volume 26daee49-3883-4830-aaea-58374d01b895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26daee49-3883-4830-aaea-58374d01b895', 'volume_size': 1}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-915617701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26daee49-3883-4830-aaea-58374d01b895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87efe4cefc5494f98bdd3b507357789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:01Z,use_quota=True,user_id='1267149db3254496a8400fc6fe7a1635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Creating volume 26daee49-3883-4830-aaea-58374d01b895 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:01 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:01 devstack sudo[86102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 1073741824
Apr 24 01:11:01 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (195ed638-88d7-46ef-bd0e-36a0ca95003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f300a9da-8383-4f6f-b24d-34efd3de01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f300a9da-8383-4f6f-b24d-34efd3de01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1518259879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=527cdbe4-db2c-4c54-b607-19091481dfac,host='devstack@QuobyteHD#QuobyteHD',id=55d4b860-aded-490c-9ecd-252b9948220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:02Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11a7a58d-0b49-4c14-a3b2-d141de4f7e31),volume_type_id=11a7a58d-0b49-4c14-a3b2-d141de4f7e31)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c059aa-4072-4c56-b596-08ee150dab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c059aa-4072-4c56-b596-08ee150dab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdaede0-5755-4c0d-8ca0-56c1e805334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdaede0-5755-4c0d-8ca0-56c1e805334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d4b860-aded-490c-9ecd-252b9948220a', 'volume_name': 'volume-55d4b860-aded-490c-9ecd-252b9948220a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c6f6c4-5f52-4fab-8dc8-dff72e8ddfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c6f6c4-5f52-4fab-8dc8-dff72e8ddfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63143024-31a7-4488-a9f0-bec3317c32cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:01 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Volume 55d4b860-aded-490c-9ecd-252b9948220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d4b860-aded-490c-9ecd-252b9948220a', 'volume_size': 1}
Apr 24 01:11:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:02 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 1073741824" returned: 0 in 0.882s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:02 devstack sudo[86108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895
Apr 24 01:11:02 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:02 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895" returned: 0 in 0.608s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=527cdbe4-db2c-4c54-b607-19091481dfac,created_at=2026-04-23T23:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1518259879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=527cdbe4-db2c-4c54-b607-19091481dfac,host='devstack@QuobyteHD#QuobyteHD',id=55d4b860-aded-490c-9ecd-252b9948220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f126f2ccb0487aa9d09635df2ef03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:02Z,use_quota=True,user_id='23f293402d2c4ddb9ea33930e648a863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11a7a58d-0b49-4c14-a3b2-d141de4f7e31),volume_type_id=11a7a58d-0b49-4c14-a3b2-d141de4f7e31)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Creating volume 55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:03 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:03 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a 1073741824
Apr 24 01:11:03 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab71b3-8ad4-451f-a9c5-1ac999f35788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26daee49-3883-4830-aaea-58374d01b895', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cf6ba4-58a9-44e3-8f6e-1041ee722477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:03 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Volume volume-26daee49-3883-4830-aaea-58374d01b895 (26daee49-3883-4830-aaea-58374d01b895): created successfully
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cf6ba4-58a9-44e3-8f6e-1041ee722477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Flow 'volume_create_manager' (879513a6-d78c-485d-bf88-5e3d6ba6c291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:03 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a5bab22f-2f4f-43e8-bdf3-ee8cd17e9d1b tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Created volume successfully.
Apr 24 01:11:03 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a 1073741824" returned: 0 in 0.985s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:04 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a
Apr 24 01:11:04 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:04 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a" returned: 0 in 0.805s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63143024-31a7-4488-a9f0-bec3317c32cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d4b860-aded-490c-9ecd-252b9948220a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a09c41-1720-486c-a8af-cc2f78d86dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Acquiring lock "cinder-26daee49-3883-4830-aaea-58374d01b895-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Volume volume-55d4b860-aded-490c-9ecd-252b9948220a (55d4b860-aded-490c-9ecd-252b9948220a): created successfully
Apr 24 01:11:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a09c41-1720-486c-a8af-cc2f78d86dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Flow 'volume_create_manager' (195ed638-88d7-46ef-bd0e-36a0ca95003b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-101e81be-ddff-43bf-a5a1-c158687dd2fc tempest-GroupSnapshotsTest-1716991509 None] Created volume successfully.
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "cinder-26daee49-3883-4830-aaea-58374d01b895-delete_volume" acquired by "delete_volume" :: waited 0.163s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Acquiring lock "cinder-quobyte-26daee49-3883-4830-aaea-58374d01b895" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "cinder-quobyte-26daee49-3883-4830-aaea-58374d01b895" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[79797f9c-deb2-4507-802c-58b78ae672e7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:05 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895
Apr 24 01:11:05 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] GroupSnapshot df543b0f-1ffc-40e0-886d-0db07dc72775: creating.
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Group snapshot df543b0f-1ffc-40e0-886d-0db07dc72775: creating. {{(pid=81902) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Creating offline snapshot 1f78f52d-2618-429f-9b0f-54dd23ee39c3 of volume 55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1a823-1e50-4bd2-87f4-2ace0c377490]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:05 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a
Apr 24 01:11:05 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:06 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895" returned: 0 in 0.789s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:06 devstack sudo[86176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895
Apr 24 01:11:06 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:06 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a" returned: 0 in 0.798s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:06 devstack sudo[86182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 1G
Apr 24 01:11:06 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:06 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-26daee49-3883-4830-aaea-58374d01b895" returned: 0 in 0.716s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "cinder-quobyte-26daee49-3883-4830-aaea-58374d01b895" released by "delete_volume" :: held 1.576s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:06 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Created reservations ['00d878aa-0225-4dbf-b6b5-9d92dd62517d', '795baffd-80d4-46ec-b27e-cdee58f32e62', 'ed884abf-97b5-4c58-bda2-24a301330e13', 'f9262110-7ca2-41a7-8880-253e21e22655'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:07 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:07 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:07 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 1G" returned: 0 in 1.063s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d4b860-aded-490c-9ecd-252b9948220a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:07 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d4b860-aded-490c-9ecd-252b9948220a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3
Apr 24 01:11:07 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:07 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.884s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:07 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Deleted volume successfully.
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-01dbbd13-c938-4038-b42f-eae27fd67083 tempest-VolumeQuotasNegativeTestJSON-1887991407 None] Lock "cinder-26daee49-3883-4830-aaea-58374d01b895-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-86cb4685-08fe-4a1a-9ce3-d5a9e1b1e63a tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-b443b347-346c-4452-9808-d224590ae597" by "attach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-86cb4685-08fe-4a1a-9ce3-d5a9e1b1e63a tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597" acquired by "attach_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-86cb4685-08fe-4a1a-9ce3-d5a9e1b1e63a tempest-VolumesActionsTest-766264414 None] Attaching volume b443b347-346c-4452-9808-d224590ae597 to instance 86809a9f-83b3-49cb-8e2f-bbcc81004d0b at mountpoint /dev/vdb on host None.
Apr 24 01:11:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-86cb4685-08fe-4a1a-9ce3-d5a9e1b1e63a tempest-VolumesActionsTest-766264414 None] Attach volume completed successfully.
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-86cb4685-08fe-4a1a-9ce3-d5a9e1b1e63a tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597" released by "attach_volume" :: held 0.122s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:08 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d4b860-aded-490c-9ecd-252b9948220a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3" returned: 0 in 0.932s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:08 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:08 devstack sudo[86201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3
Apr 24 01:11:08 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-751db084-960f-408c-8470-4ae7ad29c3b7 tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" by "detach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-751db084-960f-408c-8470-4ae7ad29c3b7 tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-751db084-960f-408c-8470-4ae7ad29c3b7 tempest-VolumesActionsTest-766264414 None] Detaching volume b443b347-346c-4452-9808-d224590ae597 from instance 86809a9f-83b3-49cb-8e2f-bbcc81004d0b.
Apr 24 01:11:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-751db084-960f-408c-8470-4ae7ad29c3b7 tempest-VolumesActionsTest-766264414 None] Detach volume completed successfully.
Apr 24 01:11:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-751db084-960f-408c-8470-4ae7ad29c3b7 tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:09 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3" returned: 0 in 0.924s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:09 devstack sudo[86205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info
Apr 24 01:11:09 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:10 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info" returned: 0 in 0.767s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:10 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:11:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:10 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info
Apr 24 01:11:10 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:11 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.info" returned: 0 in 1.040s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.627s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:11 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-28e04aff-a79b-42ea-8d53-98f6277613cc tempest-GroupSnapshotsTest-1716991509 None] group_snapshot df543b0f-1ffc-40e0-886d-0db07dc72775: created successfully
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Flow 'volume_create_manager' (d2bba041-b922-42e1-a08a-f6d4ad08d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ca7dd8-82c1-4569-8635-d513e72beb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ca7dd8-82c1-4569-8635-d513e72beb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:12Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691d015e-658f-44ee-ad6c-07637cf2f3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29ad6746587417394a78d2aea225db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:12Z,use_quota=True,user_id='94091757171949b5b66dbb67cd0c3db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43e3db2-1e13-4dd4-9714-c45cc5163585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43e3db2-1e13-4dd4-9714-c45cc5163585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4388c3-cbfb-47a0-9fd4-c63ce13ae57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:11 devstack cinder-volume[81902]: DEBUG cinder.image.glance [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Creating Keystone auth plugin from conf {{(pid=81902) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 01:11:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] group_snapshot df543b0f-1ffc-40e0-886d-0db07dc72775: deleting
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] group_snapshot df543b0f-1ffc-40e0-886d-0db07dc72775: deleting {{(pid=81902) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-1f78f52d-2618-429f-9b0f-54dd23ee39c3" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-1f78f52d-2618-429f-9b0f-54dd23ee39c3" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Deleting offline snapshot 1f78f52d-2618-429f-9b0f-54dd23ee39c3 of volume 55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] snapshot_file for this snap is: volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1edc4-cfc1-4c40-97eb-300896ac7416]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4388c3-cbfb-47a0-9fd4-c63ce13ae57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '691d015e-658f-44ee-ad6c-07637cf2f3c5', 'volume_name': 'volume-691d015e-658f-44ee-ad6c-07637cf2f3c5', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5065d2d0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31139645-23cf-42e1-a252-f918905431d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31139645-23cf-42e1-a252-f918905431d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e475bbe-2bf5-468d-addc-8dbc2310bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume 691d015e-658f-44ee-ad6c-07637cf2f3c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-691d015e-658f-44ee-ad6c-07637cf2f3c5', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5065d2d0>}
Apr 24 01:11:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Trying to clone 691d015e-658f-44ee-ad6c-07637cf2f3c5 from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]). {{(pid=81902) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 01:11:12 devstack sudo[86244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3
Apr 24 01:11:12 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 01:11:13 devstack cinder-volume[81902]: INFO cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f56982-d6ff-4b6c-acc2-3d845fde83e4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:13 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD
Apr 24 01:11:13 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:13 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3" returned: 0 in 0.990s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55d4b860-aded-490c-9ecd-252b9948220a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9040fd-1837-48ed-812a-d8e580c168be]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:13 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a
Apr 24 01:11:13 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:14 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD" returned: 0 in 0.836s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 is fetched for user 94091757171949b5b66dbb67cd0c3db4. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e7e641-207a-4d36-8673-75f3e4ae40e2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:14 devstack sudo[86278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD
Apr 24 01:11:14 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:14 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a" returned: 0 in 0.755s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:14 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3
Apr 24 01:11:14 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:15 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD" returned: 0 in 0.682s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:12Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691d015e-658f-44ee-ad6c-07637cf2f3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29ad6746587417394a78d2aea225db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:12Z,use_quota=True,user_id='94091757171949b5b66dbb67cd0c3db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Creating volume 691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:15 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:15 devstack sudo[86291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1073741824
Apr 24 01:11:15 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:15 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3" returned: 0 in 0.912s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:15 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3
Apr 24 01:11:15 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:15 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1073741824" returned: 0 in 0.892s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:16 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:16 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:16 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a.1f78f52d-2618-429f-9b0f-54dd23ee39c3" returned: 0 in 0.641s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-1f78f52d-2618-429f-9b0f-54dd23ee39c3" released by "_delete_snapshot" :: held 3.457s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" released by "delete_snapshot" :: held 3.518s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:16 devstack cinder-volume[81902]: WARNING cinder.quota [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-494568939 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-494568939, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:11:16 devstack cinder-volume[81902]: WARNING cinder.quota [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-494568939 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-494568939, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['49576433-d7b3-432c-b5f5-d120176a280b', '299bdba7-446a-4b0a-8a52-b80c5104f419', '3fadaa28-9b0a-4327-942c-727d6ca7b1e1', '0bc261d9-acdc-4295-bb97-db716a0a5820'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f5e58316-1a85-4d8d-9b93-415fcf41e6be tempest-GroupSnapshotsTest-1716991509 None] group_snapshot df543b0f-1ffc-40e0-886d-0db07dc72775: deleted successfully
Apr 24 01:11:16 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 0.586s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Attempting download of fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume 691d015e-658f-44ee-ad6c-07637cf2f3c5. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c411a44f-922c-4671-9db6-8c058119ad40]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:16 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s
Apr 24 01:11:16 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" acquired by "delete_volume" :: waited 0.040s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b90ee0-14b0-4dc4-b25c-e1273e4c1e09]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:17 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s" returned: 0 in 0.809s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:17 devstack sudo[86306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a
Apr 24 01:11:17 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:17 devstack sudo[86307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s
Apr 24 01:11:17 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:18 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s" returned: 1 in 0.822s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_g70r2k_s' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771211b-5a62-473b-bd89-1f6616f00753]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:18 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a" returned: 0 in 0.968s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:18 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a
Apr 24 01:11:18 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:18 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD
Apr 24 01:11:18 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:19 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD" returned: 0 in 0.940s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] fbaaf1b8-b24b-4256-a358-443af08ba5c6 was qcow2, converting to raw {{(pid=81902) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:19 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-55d4b860-aded-490c-9ecd-252b9948220a" returned: 0 in 0.890s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:19 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:19 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Lock "cinder-quobyte-55d4b860-aded-490c-9ecd-252b9948220a" released by "delete_volume" :: held 1.939s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:19 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:19 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['5d07917f-9a43-4d05-8404-a123fb865495'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:19 devstack cinder-volume[81902]: WARNING cinder.quota [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-494568939 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-494568939, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Created reservations ['624aa0f0-73f1-4244-b629-4ade07cf96f3', '880c219f-f219-41eb-83f5-33c37253af1c', '5b900ea1-1798-4407-8926-2dcf51ff026b', '14e0ccaa-85ba-4971-9267-de38235ab77b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:19 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:19 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:20 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.908s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:20 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.681s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:20 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6fd1bc1d-67fe-4d81-8421-371a932efcf5 tempest-GroupSnapshotsTest-1716991509 None] Delete group completed successfully.
Apr 24 01:11:21 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 2.230s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:21 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_litrv5v4devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:11:21 devstack cinder-volume[81902]: INFO cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Converted 112.00 MB image at 50.19 MB/s
Apr 24 01:11:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:21 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1G
Apr 24 01:11:21 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:22 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 1G" returned: 0 in 0.734s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:22 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0522b0-5b2c-4833-b513-be1d7a7c3507]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:22 devstack sudo[86352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:22 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:22 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 0.697s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:23 devstack sudo[86357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:23 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:23 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 1 in 0.675s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Downloaded image fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume 691d015e-658f-44ee-ad6c-07637cf2f3c5 successfully. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 for user 94091757171949b5b66dbb67cd0c3db4 is deleted. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Marking volume 691d015e-658f-44ee-ad6c-07637cf2f3c5 as bootable. {{(pid=81902) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Copying metadata from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 to 691d015e-658f-44ee-ad6c-07637cf2f3c5. {{(pid=81902) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Creating volume glance metadata for volume 691d015e-658f-44ee-ad6c-07637cf2f3c5 backed by image fbaaf1b8-b24b-4256-a358-443af08ba5c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81902) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e475bbe-2bf5-468d-addc-8dbc2310bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691d015e-658f-44ee-ad6c-07637cf2f3c5', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5065d2d0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c477d0e8-efb0-4b5b-b9ed-89b37f91edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:23 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Volume volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 (691d015e-658f-44ee-ad6c-07637cf2f3c5): created successfully
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c477d0e8-efb0-4b5b-b9ed-89b37f91edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Flow 'volume_create_manager' (d2bba041-b922-42e1-a08a-f6d4ad08d459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-5c088be6-b28d-4d3e-906b-21eaa05fcdf2 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Created volume successfully.
Apr 24 01:11:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:24 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c9b18-b9f3-47c8-9a9c-4f16a7767f6d]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:25 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:25 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:25 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 0.987s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:26 devstack sudo[86378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:11:26 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:26 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 1 in 0.908s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.979s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054', 'name': 'volume-691d015e-658f-44ee-ad6c-07637cf2f3c5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fbbddeb-bb77-4cbe-aa94-210f15284cce', 'enforce_multipath': True} {{(pid=81902) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 01:11:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-ccd2ebb2-e9f6-4920-9f66-c2f035fba371 req-a959ae02-9f51-4b3c-b0cb-148f04a75f8d tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] attachment_update completed successfully.
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Flow 'volume_create_manager' (d226a140-e059-495c-b5f5-4db16f6f8c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9984e9c8-0402-4873-94b5-a10887f20833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9984e9c8-0402-4873-94b5-a10887f20833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1178600576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cb989d-1a25-45c2-9b8b-d2f803d32621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b68c18414d4708929ccd7630b04fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:29Z,use_quota=True,user_id='4ab4927ce835428c924f3565f95c8ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7b286-e701-47d4-8642-e56c6043ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7b286-e701-47d4-8642-e56c6043ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e810a7-d565-4798-ba55-00d0d93fd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:28 devstack cinder-volume[81902]: DEBUG cinder.image.glance [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Creating Keystone auth plugin from conf {{(pid=81902) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e810a7-d565-4798-ba55-00d0d93fd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7cb989d-1a25-45c2-9b8b-d2f803d32621', 'volume_name': 'volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5055c610>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167cc9a-06b1-4fa0-b128-adad6370b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167cc9a-06b1-4fa0-b128-adad6370b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f423b6-41e1-4dea-b5f3-d52d8184dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:29 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Volume d7cb989d-1a25-45c2-9b8b-d2f803d32621: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5055c610>}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Trying to clone d7cb989d-1a25-45c2-9b8b-d2f803d32621 from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]). {{(pid=81902) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 01:11:29 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a58fb9-af76-4001-97c9-5db438889c1b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:29 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD
Apr 24 01:11:29 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:30 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:30 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 is fetched for user 4ab4927ce835428c924f3565f95c8ceb. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 01:11:30 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8be579-65c4-46bd-8276-eae6d870d31f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:30 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD
Apr 24 01:11:30 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:31 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1178600576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cb989d-1a25-45c2-9b8b-d2f803d32621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b68c18414d4708929ccd7630b04fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:29Z,use_quota=True,user_id='4ab4927ce835428c924f3565f95c8ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Creating volume d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:31 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:31 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1073741824
Apr 24 01:11:31 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:32 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1073741824" returned: 0 in 0.768s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:32 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:32 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:32 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 0 in 0.704s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Attempting download of fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume d7cb989d-1a25-45c2-9b8b-d2f803d32621. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacd82eb-b46d-420b-9e51-e9ff6f16b4d0]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:33 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is
Apr 24 01:11:33 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:33 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is" returned: 0 in 0.725s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:33 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is
Apr 24 01:11:33 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-13505205-6cc1-46e4-b259-67e2e169fe65 tempest-GroupsTest-190989886 None] Group tempest-Group1-262019668: creating
Apr 24 01:11:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-13505205-6cc1-46e4-b259-67e2e169fe65 tempest-GroupsTest-190989886 None] Group tempest-Group1-262019668: created successfully
Apr 24 01:11:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-13505205-6cc1-46e4-b259-67e2e169fe65 tempest-GroupsTest-190989886 None] Create group completed successfully.
Apr 24 01:11:34 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is" returned: 1 in 0.847s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_d6zbl5is' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:34 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a809753d-d320-414e-a951-2f4552f366c9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:34 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD
Apr 24 01:11:34 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:35 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:35 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] fbaaf1b8-b24b-4256-a358-443af08ba5c6 was qcow2, converting to raw {{(pid=81902) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 01:11:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:35 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:35 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:35 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a3fd9abc-1509-4608-8e41-d6505b788c87 tempest-GroupsTest-190989886 None] Group tempest-Group2-1296209782: creating
Apr 24 01:11:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a3fd9abc-1509-4608-8e41-d6505b788c87 tempest-GroupsTest-190989886 None] Group tempest-Group2-1296209782: created successfully
Apr 24 01:11:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a3fd9abc-1509-4608-8e41-d6505b788c87 tempest-GroupsTest-190989886 None] Create group completed successfully.
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (bc06f304-8696-459b-a81b-394975e213db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1718348a-d157-46e2-b48b-daa833782c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1718348a-d157-46e2-b48b-daa833782c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125609442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebee20d9-15d7-4849-9004-de89b8d12c12,host='devstack@QuobyteHD#QuobyteHD',id=392036c0-5cbb-42ac-82d7-70a16bf0cf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:38Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff74114-a08a-4d2c-b366-432bfed01519),volume_type_id=9ff74114-a08a-4d2c-b366-432bfed01519)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c33f7d-9079-4d66-a89d-56bc0bb15741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c33f7d-9079-4d66-a89d-56bc0bb15741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0744aac-58d7-45c8-b2a2-7e5b9ab6ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0744aac-58d7-45c8-b2a2-7e5b9ab6ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392036c0-5cbb-42ac-82d7-70a16bf0cf8b', 'volume_name': 'volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2b22ca-dc56-4ccf-8d1d-2d554cd3a282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2b22ca-dc56-4ccf-8d1d-2d554cd3a282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd5c46-cd1a-4770-8ec9-9e6c9de02b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:38 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Volume 392036c0-5cbb-42ac-82d7-70a16bf0cf8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b', 'volume_size': 1}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ebee20d9-15d7-4849-9004-de89b8d12c12,created_at=2026-04-23T23:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125609442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebee20d9-15d7-4849-9004-de89b8d12c12,host='devstack@QuobyteHD#QuobyteHD',id=392036c0-5cbb-42ac-82d7-70a16bf0cf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:38Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff74114-a08a-4d2c-b366-432bfed01519),volume_type_id=9ff74114-a08a-4d2c-b366-432bfed01519)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Creating volume 392036c0-5cbb-42ac-82d7-70a16bf0cf8b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:38 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:38 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b 1073741824
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-13608725-efcf-4657-8753-2a2a33180bfa tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-b443b347-346c-4452-9808-d224590ae597" by "attach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:38 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-13608725-efcf-4657-8753-2a2a33180bfa tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597" acquired by "attach_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:38 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-13608725-efcf-4657-8753-2a2a33180bfa tempest-VolumesActionsTest-766264414 None] Attaching volume b443b347-346c-4452-9808-d224590ae597 to instance 43b033aa-71e8-4c3a-aefe-1c1a4d452604 at mountpoint /dev/vdb on host None.
Apr 24 01:11:38 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-13608725-efcf-4657-8753-2a2a33180bfa tempest-VolumesActionsTest-766264414 None] Attach volume completed successfully.
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-13608725-efcf-4657-8753-2a2a33180bfa tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597" released by "attach_volume" :: held 0.158s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:38 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 0 in 3.461s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lk8jza8idevstack@QuobyteHD, size 112.00 MB, duration 3.46 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:11:38 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Converted 112.00 MB image at 32.32 MB/s
Apr 24 01:11:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:38 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1G
Apr 24 01:11:38 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5edc821c-bbbb-4d48-889c-3ecd3722dae2 tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" by "detach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5edc821c-bbbb-4d48-889c-3ecd3722dae2 tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5edc821c-bbbb-4d48-889c-3ecd3722dae2 tempest-VolumesActionsTest-766264414 None] Detaching volume b443b347-346c-4452-9808-d224590ae597 from instance 43b033aa-71e8-4c3a-aefe-1c1a4d452604.
Apr 24 01:11:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5edc821c-bbbb-4d48-889c-3ecd3722dae2 tempest-VolumesActionsTest-766264414 None] Detach volume completed successfully.
Apr 24 01:11:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5edc821c-bbbb-4d48-889c-3ecd3722dae2 tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-detach_volume" released by "detach_volume" :: held 0.291s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:40 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b 1073741824" returned: 0 in 2.078s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:40 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b
Apr 24 01:11:40 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:40 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 1G" returned: 0 in 2.052s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[514febec-09cf-4f5c-977a-3c2113bc234f]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:41 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:41 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:42 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 0 in 1.056s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:42 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:42 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:42 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" returned: 0 in 1.617s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] <== create_volume: return (3836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.841s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd5c46-cd1a-4770-8ec9-9e6c9de02b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c16169-c24b-4536-897b-e36f8517e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Volume volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b (392036c0-5cbb-42ac-82d7-70a16bf0cf8b): created successfully
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c16169-c24b-4536-897b-e36f8517e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (bc06f304-8696-459b-a81b-394975e213db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-34b99562-a365-4900-8d19-10c9db900a15 tempest-GroupsTest-190989886 None] Created volume successfully.
Apr 24 01:11:43 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 1 in 1.003s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Downloaded image fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume d7cb989d-1a25-45c2-9b8b-d2f803d32621 successfully. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 for user 4ab4927ce835428c924f3565f95c8ceb is deleted. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Marking volume d7cb989d-1a25-45c2-9b8b-d2f803d32621 as bootable. {{(pid=81902) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Copying metadata from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 to d7cb989d-1a25-45c2-9b8b-d2f803d32621. {{(pid=81902) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Creating volume glance metadata for volume d7cb989d-1a25-45c2-9b8b-d2f803d32621 backed by image fbaaf1b8-b24b-4256-a358-443af08ba5c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81902) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f423b6-41e1-4dea-b5f3-d52d8184dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf5055c610>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1f99b7-b0cb-4e52-944f-844b3626a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Volume volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 (d7cb989d-1a25-45c2-9b8b-d2f803d32621): created successfully
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1f99b7-b0cb-4e52-944f-844b3626a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Flow 'volume_create_manager' (d226a140-e059-495c-b5f5-4db16f6f8c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-184bf167-e73e-454c-953e-bd258f26e14d tempest-VolumesImageMetadata-413886715 None] Created volume successfully.
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Acquiring lock "cinder-quobyte-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" acquired by "delete_volume" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a9a75-eb96-4095-adf6-fa87628c1523]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:44 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b
Apr 24 01:11:44 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Acquiring lock "cinder-d7cb989d-1a25-45c2-9b8b-d2f803d32621-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "cinder-d7cb989d-1a25-45c2-9b8b-d2f803d32621-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Acquiring lock "cinder-quobyte-d7cb989d-1a25-45c2-9b8b-d2f803d32621" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "cinder-quobyte-d7cb989d-1a25-45c2-9b8b-d2f803d32621" acquired by "delete_volume" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32fd934-2d9f-4199-a013-ab796f489e27]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:44 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:44 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:44 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" returned: 0 in 0.931s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:44 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b
Apr 24 01:11:44 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:45 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 0 in 0.587s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:45 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:45 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:45 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" returned: 0 in 0.597s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-392036c0-5cbb-42ac-82d7-70a16bf0cf8b" released by "delete_volume" :: held 1.650s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Created reservations ['c1f1c2df-d145-4f6d-a0b2-b9e993503311'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:45 devstack cinder-volume[81902]: WARNING cinder.quota [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1397790593 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1397790593, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:11:45 devstack cinder-volume[81902]: WARNING cinder.quota [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1397790593 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1397790593, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Created reservations ['35985d69-5074-4d07-bc3a-5a78732607d8', 'c7c5a665-d3c9-43c8-9c63-f89c81a9bd8d', '05cab832-a6f0-48c1-b831-0af8204b90b7', '2b803e85-85d0-40e6-8466-9394a5258371'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:45 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:45 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:45 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 1 in 0.781s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:11:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:45 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621
Apr 24 01:11:45 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Created reservations ['8cc750d9-4f82-4287-a999-31e954f960f9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:46 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:46 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:46 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d7cb989d-1a25-45c2-9b8b-d2f803d32621" returned: 0 in 0.721s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "cinder-quobyte-d7cb989d-1a25-45c2-9b8b-d2f803d32621" released by "delete_volume" :: held 2.176s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Created reservations ['5be6c5f2-e129-40ab-8217-b97b33886d6a', '5b1fd89f-52ef-4309-9412-c2872757ed9a', '66289707-1b60-40d3-af83-db3118047973', 'be480f08-a6d9-4f6a-b24d-d4a859db2440'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:11:46 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.980s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:46 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-643707ff-8fcb-423d-abc9-b9e706e0aabf tempest-GroupsTest-190989886 None] Delete group completed successfully.
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:46 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:11:46 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:47 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.656s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:47 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9b1a742c-ef5e-4e40-aa8a-71a5c85227fb tempest-GroupsTest-190989886 None] Delete group completed successfully.
Apr 24 01:11:47 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.581s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:47 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:11:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Deleted volume successfully.
Apr 24 01:11:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d1a6d092-ff12-4ac3-bf6a-a0f8e91a94a6 tempest-VolumesImageMetadata-413886715 None] Lock "cinder-d7cb989d-1a25-45c2-9b8b-d2f803d32621-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:11:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f6146b60-f48d-4967-8a3f-e31ca4bba58f tempest-GroupsTest-190989886 None] Group tempest-GroupsTest-Group-1448340078: creating
Apr 24 01:11:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f6146b60-f48d-4967-8a3f-e31ca4bba58f tempest-GroupsTest-190989886 None] Group tempest-GroupsTest-Group-1448340078: created successfully
Apr 24 01:11:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f6146b60-f48d-4967-8a3f-e31ca4bba58f tempest-GroupsTest-190989886 None] Create group completed successfully.
Apr 24 01:11:49 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (8d4b65b4-c614-4d87-9d23-15ed72832506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e7d8c4-8185-4fc5-bbc4-dc46a2467726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e7d8c4-8185-4fc5-bbc4-dc46a2467726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727583500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36e3916e-6cae-4910-92c4-56da5acacd30,host='devstack@QuobyteHD#QuobyteHD',id=f1a90c1d-72de-4302-b727-9599d491b9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:50Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43115b2c-8ab1-4a05-baec-40682be4dbac),volume_type_id=43115b2c-8ab1-4a05-baec-40682be4dbac)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f64bac-bfe1-48a7-aa0a-60f44677f1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f64bac-bfe1-48a7-aa0a-60f44677f1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30449849-4bc0-4988-9d50-efb5c34a16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30449849-4bc0-4988-9d50-efb5c34a16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a90c1d-72de-4302-b727-9599d491b9d3', 'volume_name': 'volume-f1a90c1d-72de-4302-b727-9599d491b9d3', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aa39c5-0be0-498d-aa5a-994794781c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aa39c5-0be0-498d-aa5a-994794781c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a531df3e-c302-4bb6-b09d-07184c4e0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:50 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Volume f1a90c1d-72de-4302-b727-9599d491b9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a90c1d-72de-4302-b727-9599d491b9d3', 'volume_size': 1}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36e3916e-6cae-4910-92c4-56da5acacd30,created_at=2026-04-23T23:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727583500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36e3916e-6cae-4910-92c4-56da5acacd30,host='devstack@QuobyteHD#QuobyteHD',id=f1a90c1d-72de-4302-b727-9599d491b9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:50Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43115b2c-8ab1-4a05-baec-40682be4dbac),volume_type_id=43115b2c-8ab1-4a05-baec-40682be4dbac)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Creating volume f1a90c1d-72de-4302-b727-9599d491b9d3 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:11:50 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:50 devstack sudo[86702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 1073741824
Apr 24 01:11:50 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:50 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 1073741824" returned: 0 in 0.811s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:51 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3
Apr 24 01:11:51 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=124,cinder:INSERT=31,cinder:UPDATE=129,cinder:DELETE=2 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=121,cinder:INSERT=46,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Flow 'volume_create_manager' (e5645d6e-9eac-4244-a5f9-a612100aa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6086c1a4-c74d-4bd5-aca8-cdd0e64b5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6086c1a4-c74d-4bd5-aca8-cdd0e64b5099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-117078806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6a40a4-138d-4f8d-a18d-3efb872e4c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8988707e8452e8258ffbf8f38ec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:51Z,use_quota=True,user_id='b0fd60e9264a4e40a0f5471c1a322d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f8fed5-461a-4678-83dd-6c7e573ae017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f8fed5-461a-4678-83dd-6c7e573ae017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43064c3c-b3f1-4a8b-86ae-9d04aff3cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43064c3c-b3f1-4a8b-86ae-9d04aff3cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6a40a4-138d-4f8d-a18d-3efb872e4c91', 'volume_name': 'volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5abf864-b191-4974-b9cb-be7049fea99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5abf864-b191-4974-b9cb-be7049fea99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465d6f3c-c90f-4c33-af44-f3d758907c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Volume fa6a40a4-138d-4f8d-a18d-3efb872e4c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91', 'volume_size': 1}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:11:51 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3" returned: 0 in 0.586s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.327s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a531df3e-c302-4bb6-b09d-07184c4e0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a90c1d-72de-4302-b727-9599d491b9d3', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73177ec-60f1-4af9-8a62-1b7f4fcfc732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[967142ee-6c5a-4aa8-b0de-bff1903d95e0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Volume volume-f1a90c1d-72de-4302-b727-9599d491b9d3 (f1a90c1d-72de-4302-b727-9599d491b9d3): created successfully
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73177ec-60f1-4af9-8a62-1b7f4fcfc732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (8d4b65b4-c614-4d87-9d23-15ed72832506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22b0eb4b-ea26-4429-9443-1d6c60cc48ef tempest-GroupsTest-190989886 None] Created volume successfully.
Apr 24 01:11:51 devstack sudo[86712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:11:51 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:52 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[785db91c-f87b-4cbc-9074-3ba98fec034b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:52 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:11:52 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:52 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.606s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.686c09ce-5341-46ee-94d9-98a5ea6fc63cqkjz46k8.img {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:11:52 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.686c09ce-5341-46ee-94d9-98a5ea6fc63cqkjz46k8.img
Apr 24 01:11:52 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (3be0baee-c77f-4fe2-b9a3-70909a9b3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9c64c-13d7-4b2b-831e-ecf522006797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9c64c-13d7-4b2b-831e-ecf522006797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577124524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36e3916e-6cae-4910-92c4-56da5acacd30,host='devstack@QuobyteHD#QuobyteHD',id=a82e77f6-8c2a-4ebf-961a-810761a72d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:53Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43115b2c-8ab1-4a05-baec-40682be4dbac),volume_type_id=43115b2c-8ab1-4a05-baec-40682be4dbac)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6466ad-f2bb-4bd0-a031-ddc10b6bbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6466ad-f2bb-4bd0-a031-ddc10b6bbf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c2e9b0-04b1-4b13-a7d1-d18169eb6314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c2e9b0-04b1-4b13-a7d1-d18169eb6314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82e77f6-8c2a-4ebf-961a-810761a72d70', 'volume_name': 'volume-a82e77f6-8c2a-4ebf-961a-810761a72d70', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59130f5-9238-4cfa-af30-b6f51472d2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59130f5-9238-4cfa-af30-b6f51472d2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99907e2a-bbc3-46c3-8592-49d25c393aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:11:52 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Volume a82e77f6-8c2a-4ebf-961a-810761a72d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82e77f6-8c2a-4ebf-961a-810761a72d70', 'volume_size': 1}
Apr 24 01:11:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:00 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.686c09ce-5341-46ee-94d9-98a5ea6fc63cqkjz46k8.img" returned: 0 in 7.807s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[45726b17-b440-4e4a-a06c-8cd9ab7a5dc9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:00 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:00 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:01 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.748s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:01 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.686c09ce-5341-46ee-94d9-98a5ea6fc63cqkjz46k8.img {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:12:01 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Converted 1024.00 MB image at 131.14 MB/s
Apr 24 01:12:01 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] 686c09ce-5341-46ee-94d9-98a5ea6fc63c was raw, no need to convert to raw {{(pid=81902) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 24 01:12:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:12:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=3 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:12:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-476fdec8-2d05-45be-8742-e99612bf30a5 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Terminate volume connection completed successfully.
Apr 24 01:12:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-476fdec8-2d05-45be-8742-e99612bf30a5 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Deleting attachment 5fbbddeb-bb77-4cbe-aa94-210f15284cce. {{(pid=81902) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "cinder-691d015e-658f-44ee-ad6c-07637cf2f3c5-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-691d015e-658f-44ee-ad6c-07637cf2f3c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "cinder-quobyte-691d015e-658f-44ee-ad6c-07637cf2f3c5" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-quobyte-691d015e-658f-44ee-ad6c-07637cf2f3c5" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd55e1-4f3b-4224-a1fe-3d0d887761db]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:13 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:12:13 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:13 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 0.762s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:14 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:12:14 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:14 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 1 in 0.715s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:12:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:14 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5
Apr 24 01:12:14 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:15 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-691d015e-658f-44ee-ad6c-07637cf2f3c5" returned: 0 in 0.532s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-quobyte-691d015e-658f-44ee-ad6c-07637cf2f3c5" released by "delete_volume" :: held 2.117s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG cinder.quota [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Created reservations ['40e7cf70-4a1a-4e20-b369-45f14332d540', '0a91d623-97ea-4a41-ade4-5fad09838152', '308cba82-850b-4cf3-8c31-dd639f35c1ff', '7e90ae4f-97c8-43ca-940f-7bfb27f71d60'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:15 devstack sudo[86937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:15 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:15 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.653s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:15 devstack cinder-volume[81902]: DEBUG cinder.manager [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Deleted volume successfully.
Apr 24 01:12:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-59dde7d6-1ef7-4f13-9094-24cebf0c54d0 req-68f7ce87-972b-4fb1-be3b-9d13a38a51b7 tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-691d015e-658f-44ee-ad6c-07637cf2f3c5-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:19 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:19 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:19 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.587s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.476s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Uploaded volume to glance image-id: 686c09ce-5341-46ee-94d9-98a5ea6fc63c. {{(pid=81902) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.606s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-117078806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6a40a4-138d-4f8d-a18d-3efb872e4c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8988707e8452e8258ffbf8f38ec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:51Z,use_quota=True,user_id='b0fd60e9264a4e40a0f5471c1a322d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Creating volume fa6a40a4-138d-4f8d-a18d-3efb872e4c91 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:20 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:20 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 1073741824
Apr 24 01:12:20 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:20 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-634224f5-f881-45fb-bbdd-f6bbc6577d8e tempest-VolumesActionsTest-766264414 None] Copy volume to image completed successfully.
Apr 24 01:12:20 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 1073741824" returned: 0 in 0.650s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:20 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91
Apr 24 01:12:20 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:21 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" returned: 0 in 0.553s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.357s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36e3916e-6cae-4910-92c4-56da5acacd30,created_at=2026-04-23T23:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577124524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36e3916e-6cae-4910-92c4-56da5acacd30,host='devstack@QuobyteHD#QuobyteHD',id=a82e77f6-8c2a-4ebf-961a-810761a72d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88764cb08ae64db79e04611ae3a80aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:53Z,use_quota=True,user_id='7787c3c7d2c846aa83dea39ffab9e8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43115b2c-8ab1-4a05-baec-40682be4dbac),volume_type_id=43115b2c-8ab1-4a05-baec-40682be4dbac)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Creating volume a82e77f6-8c2a-4ebf-961a-810761a72d70 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:21 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465d6f3c-c90f-4c33-af44-f3d758907c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:21 devstack sudo[86985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 1073741824
Apr 24 01:12:21 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47938de5-56fd-447c-adb4-eac045afc84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:21 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Volume volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 (fa6a40a4-138d-4f8d-a18d-3efb872e4c91): created successfully
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47938de5-56fd-447c-adb4-eac045afc84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Flow 'volume_create_manager' (e5645d6e-9eac-4244-a5f9-a612100aa188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:21 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-93e48d96-5434-4328-9f6d-6e63e4902382 tempest-VolumesMetadataTest-1372852833 None] Created volume successfully.
Apr 24 01:12:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:22 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 1073741824" returned: 0 in 0.778s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:22 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70
Apr 24 01:12:22 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Acquiring lock "cinder-fa6a40a4-138d-4f8d-a18d-3efb872e4c91-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "cinder-fa6a40a4-138d-4f8d-a18d-3efb872e4c91-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Acquiring lock "cinder-quobyte-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "cinder-quobyte-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e0a1d7-7206-46d8-9252-6c8e6d23fcc4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:22 devstack sudo[86993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91
Apr 24 01:12:22 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:22 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70" returned: 0 in 0.508s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99907e2a-bbc3-46c3-8592-49d25c393aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82e77f6-8c2a-4ebf-961a-810761a72d70', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da78fda-90c1-4e8d-bd0e-dcaf898160be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec577c-5984-47b1-bcf1-b4a83e2200a8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:22 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Volume volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 (a82e77f6-8c2a-4ebf-961a-810761a72d70): created successfully
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da78fda-90c1-4e8d-bd0e-dcaf898160be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Flow 'volume_create_manager' (3be0baee-c77f-4fe2-b9a3-70909a9b3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:22 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2f4367b6-8eb8-42a6-b6d2-415dd712612e tempest-GroupsTest-190989886 None] Created volume successfully.
Apr 24 01:12:22 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:22 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:23 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" returned: 0 in 0.579s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:23 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91
Apr 24 01:12:23 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:23 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.605s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13cf2ec-11dd-4e21-929d-f418fd9c6723]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:23 devstack sudo[87006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:23 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b96fd76c-fe58-4e80-aebe-d684c00e3ab0 tempest-GroupsTest-190989886 None] Update group completed successfully.
Apr 24 01:12:23 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" returned: 0 in 0.522s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "cinder-quobyte-fa6a40a4-138d-4f8d-a18d-3efb872e4c91" released by "delete_volume" :: held 1.142s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Created reservations ['f44f539a-e9ba-4814-8a7b-49b8a1410850', '077c3d13-918b-477e-b67c-4aa46780edcb', '4e179044-9405-4aee-812d-1d36109f3752', '1323ef25-a71a-40ad-a8d9-cd80b00753d3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:23 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:23 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:23 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.642s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:24 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img
Apr 24 01:12:24 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:24 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.539s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:24 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Deleted volume successfully.
Apr 24 01:12:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-38293b92-6880-4223-b0cc-7e02fb807160 tempest-VolumesMetadataTest-1372852833 None] Lock "cinder-fa6a40a4-138d-4f8d-a18d-3efb872e4c91-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7dcdbd43-ee83-47d5-9434-a1ca9f9cc025 tempest-GroupsTest-190989886 None] Update group completed successfully.
Apr 24 01:12:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Acquiring lock "cinder-quobyte-a82e77f6-8c2a-4ebf-961a-810761a72d70" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-a82e77f6-8c2a-4ebf-961a-810761a72d70" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:27 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e21ea-4c3b-409a-a884-d85c1f46b6d8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:27 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70
Apr 24 01:12:27 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:28 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70" returned: 0 in 1.475s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:28 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70
Apr 24 01:12:28 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:29 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a82e77f6-8c2a-4ebf-961a-810761a72d70" returned: 0 in 1.299s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-a82e77f6-8c2a-4ebf-961a-810761a72d70" released by "delete_volume" :: held 2.909s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Acquiring lock "cinder-quobyte-f1a90c1d-72de-4302-b727-9599d491b9d3" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-f1a90c1d-72de-4302-b727-9599d491b9d3" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e37441-b226-4b07-af9a-87cc66f69aee]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:30 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3
Apr 24 01:12:30 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:30 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img" returned: 0 in 6.808s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d229be6-a0ec-4d1f-966e-b42d07eb135a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:30 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:30 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:31 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3" returned: 0 in 0.969s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:31 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3
Apr 24 01:12:31 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-f52091cc-c738-4962-80ca-d93feda96774 req-cc9be691-b06e-493f-a42e-6656d9d1d91c tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Terminate volume connection completed successfully.
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-f52091cc-c738-4962-80ca-d93feda96774 req-cc9be691-b06e-493f-a42e-6656d9d1d91c tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Deleting attachment c53e3b95-8edb-44c6-8462-86b4089e486d. {{(pid=81902) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 01:12:31 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.817s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:12:31 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Converted 1024.00 MB image at 150.36 MB/s
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] 5d743501-e43b-42d8-a1c3-52c3261ef042 was raw, converting to qcow2 {{(pid=81902) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73832b-0fae-48df-bd68-1f4b1e41c84f]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:31 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img
Apr 24 01:12:31 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:31 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f1a90c1d-72de-4302-b727-9599d491b9d3" returned: 0 in 0.611s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "cinder-quobyte-f1a90c1d-72de-4302-b727-9599d491b9d3" released by "delete_volume" :: held 1.706s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Created reservations ['5308a0a6-2c47-4782-a431-87e90abf5435'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:31 devstack cinder-volume[81902]: WARNING cinder.quota [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1215889245 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1215889245, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:12:31 devstack cinder-volume[81902]: WARNING cinder.quota [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1215889245 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1215889245, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:12:31 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Created reservations ['5735ef57-a89a-4ffb-a267-eed664eb7731', '1e2b4741-f76e-4d25-89dc-efad6a1d24e5', '9e0ac614-21ba-4b09-b007-41f3f4aff570', 'f199d4f2-fb0c-464e-8755-72475088d2fb'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "cinder-f6b72fbc-4bd1-44b5-b61e-df149c062805-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-f6b72fbc-4bd1-44b5-b61e-df149c062805-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "cinder-quobyte-f6b72fbc-4bd1-44b5-b61e-df149c062805" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-quobyte-f6b72fbc-4bd1-44b5-b61e-df149c062805" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f4369d-8bd0-4b3b-a703-949abb052d5f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Created reservations ['cd912560-e4a4-4881-9b5a-5483801ae0eb', '58e38973-8aee-497d-9cc6-c1f88018df02', '3a385508-2a4e-49c2-b920-57f0a3d8f4b0', 'ec53ac0f-05d3-4fb7-a21c-0c0fe5d36abe'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:32 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805
Apr 24 01:12:32 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:32 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:32 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img
Apr 24 01:12:32 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:32 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:32 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:33 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805" returned: 0 in 0.854s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:33 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805
Apr 24 01:12:33 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:33 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img" returned: 1 in 0.964s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img /opt/stack/data/cinder/conversion/vol_upload_w8sing3o {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:33 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:33 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img /opt/stack/data/cinder/conversion/vol_upload_w8sing3o
Apr 24 01:12:33 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.886s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:33 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-69641e0c-1ff4-4dab-b1b9-460f5d07f5d8 tempest-GroupsTest-190989886 None] Delete group completed successfully.
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Flow 'volume_create_manager' (089b8964-473e-485b-a4e9-3410fc0ad629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cdb408-0d7a-4cd0-9c9e-7d77fd4fac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cdb408-0d7a-4cd0-9c9e-7d77fd4fac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1436340181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f10b24-0141-4f27-ad79-d2b0f9ac23b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab1489211043e38543b2c7bbbb22d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:33Z,use_quota=True,user_id='8e74f2d0977d4d6cb3dbd7492c1b8777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246c3a2e-1af6-4fa3-93de-eaba84c1b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246c3a2e-1af6-4fa3-93de-eaba84c1b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104105a3-dd62-40af-b660-bdcb84638ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104105a3-dd62-40af-b660-bdcb84638ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f10b24-0141-4f27-ad79-d2b0f9ac23b5', 'volume_name': 'volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f4aa3-11f6-4c51-a1da-346e9652d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f4aa3-11f6-4c51-a1da-346e9652d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629c68eb-d3c2-4a8c-b294-314f6386a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:33 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Volume 28f10b24-0141-4f27-ad79-d2b0f9ac23b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5', 'volume_size': 1}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:33 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f6b72fbc-4bd1-44b5-b61e-df149c062805" returned: 0 in 0.767s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-quobyte-f6b72fbc-4bd1-44b5-b61e-df149c062805" released by "delete_volume" :: held 1.673s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.quota [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Created reservations ['7d2bf7e0-19a3-42f4-9a4e-8bcd1698d4c1', 'cde2928a-d2b1-490e-aa42-0ba019177da1', '4c3a2394-fd1d-4085-a0c6-52f6c6d1108b', 'd881e32f-db16-45dc-9a71-8a6c555ae2b4'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:33 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img /opt/stack/data/cinder/conversion/vol_upload_w8sing3o" returned: 0 in 0.666s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Image conversion details: src /opt/stack/data/cinder/conversion/b443b347-346c-4452-9808-d224590ae597.temp_image.5d743501-e43b-42d8-a1c3-52c3261ef042o4mosr79.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w8sing3o {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:12:33 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:33 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7155110-2e71-46cd-b0f5-13a7b7090922]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w8sing3o {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:34 devstack sudo[87137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:34 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:34 devstack sudo[87138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w8sing3o
Apr 24 01:12:34 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:34 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.593s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:34 devstack cinder-volume[81902]: DEBUG cinder.manager [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Deleted volume successfully.
Apr 24 01:12:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-f52091cc-c738-4962-80ca-d93feda96774 req-f506684f-2abd-4d78-b104-7a1bee17d81e tempest-ServerBootFromVolumeStableRescueTest-1388843700 None] Lock "cinder-f6b72fbc-4bd1-44b5-b61e-df149c062805-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:34 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w8sing3o" returned: 0 in 0.694s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.834s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Uploaded volume to glance image-id: 5d743501-e43b-42d8-a1c3-52c3261ef042. {{(pid=81902) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1436340181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f10b24-0141-4f27-ad79-d2b0f9ac23b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab1489211043e38543b2c7bbbb22d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:33Z,use_quota=True,user_id='8e74f2d0977d4d6cb3dbd7492c1b8777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Creating volume 28f10b24-0141-4f27-ad79-d2b0f9ac23b5 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:36 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b01dff19-ed3e-4080-b6ec-ff6aeb27ce76 tempest-VolumesActionsTest-766264414 None] Copy volume to image completed successfully.
Apr 24 01:12:36 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 1073741824
Apr 24 01:12:36 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-b443b347-346c-4452-9808-d224590ae597-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:37 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Acquiring lock "cinder-quobyte-b443b347-346c-4452-9808-d224590ae597" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 1073741824" returned: 0 in 1.215s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "cinder-quobyte-b443b347-346c-4452-9808-d224590ae597" acquired by "delete_volume" :: waited 0.045s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e9304-552e-49bd-b061-712222ec1ced]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:37 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5
Apr 24 01:12:37 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:37 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:37 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:38 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.636s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:38 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597
Apr 24 01:12:38 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:38 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" returned: 0 in 0.782s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629c68eb-d3c2-4a8c-b294-314f6386a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a94cc-63e8-4301-a404-49f00d878438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:38 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Volume volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 (28f10b24-0141-4f27-ad79-d2b0f9ac23b5): created successfully
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a94cc-63e8-4301-a404-49f00d878438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Flow 'volume_create_manager' (089b8964-473e-485b-a4e9-3410fc0ad629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:38 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-031574f2-32fa-4178-bc87-b95a921bb6fe tempest-VolumesTransfersTest-532603585 None] Created volume successfully.
Apr 24 01:12:39 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b443b347-346c-4452-9808-d224590ae597" returned: 0 in 0.694s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "cinder-quobyte-b443b347-346c-4452-9808-d224590ae597" released by "delete_volume" :: held 1.385s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Created reservations ['fec3b8ed-5d44-4009-aa73-1afce4f7ea6c', 'e95d986c-672c-4c2c-89ed-faba668656b6', '083d04d1-fb89-4415-9090-18950abec25e', '94ac0f47-61d7-4296-a3dd-2e84e14e4623'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:39 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:39 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:39 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.510s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Deleted volume successfully.
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-79416a7a-d0c8-4dc2-b854-9c0168b2196b tempest-VolumesActionsTest-766264414 None] Lock "cinder-b443b347-346c-4452-9808-d224590ae597-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Flow 'volume_create_manager' (de5d9aa6-18ad-481a-8041-c3dd9b8c2255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f740d97-9a90-4ff2-ba87-c9fd34ba5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f740d97-9a90-4ff2-ba87-c9fd34ba5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2028875284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdb9282-623e-4909-928e-49c21cc80d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47fd9d17a3d4e248d07c96e7cb8bb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:40Z,use_quota=True,user_id='641eb9ea39f7466bbe66c22792029fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f67acc-2726-4e9f-bdec-3fa567491541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f67acc-2726-4e9f-bdec-3fa567491541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb33f61-9511-4651-8eaa-b59002baec96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb33f61-9511-4651-8eaa-b59002baec96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfdb9282-623e-4909-928e-49c21cc80d10', 'volume_name': 'volume-cfdb9282-623e-4909-928e-49c21cc80d10', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16170023-ad8e-4baf-a346-f018704ec0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16170023-ad8e-4baf-a346-f018704ec0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a2822e-14e3-47ca-abee-3ce4393b4b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Volume cfdb9282-623e-4909-928e-49c21cc80d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfdb9282-623e-4909-928e-49c21cc80d10', 'volume_size': 1}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2028875284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdb9282-623e-4909-928e-49c21cc80d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47fd9d17a3d4e248d07c96e7cb8bb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:40Z,use_quota=True,user_id='641eb9ea39f7466bbe66c22792029fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Creating volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:40 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f899d2a7-2fb3-41ee-9962-c28ae4489021 tempest-VolumesTransfersTest-957764581 None] Transfer volume completed successfully.
Apr 24 01:12:40 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 1073741824
Apr 24 01:12:40 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:41 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 1073741824" returned: 0 in 1.082s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:41 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10
Apr 24 01:12:41 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Acquiring lock "cinder-28f10b24-0141-4f27-ad79-d2b0f9ac23b5-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "cinder-28f10b24-0141-4f27-ad79-d2b0f9ac23b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Acquiring lock "cinder-quobyte-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "cinder-quobyte-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c42ad-7cda-493f-bed5-bf49750d4a08]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:41 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5
Apr 24 01:12:41 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:41 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10" returned: 0 in 0.643s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a2822e-14e3-47ca-abee-3ce4393b4b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdb9282-623e-4909-928e-49c21cc80d10', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ced38c-41e5-4b64-afeb-f24f1e2e1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Volume volume-cfdb9282-623e-4909-928e-49c21cc80d10 (cfdb9282-623e-4909-928e-49c21cc80d10): created successfully
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ced38c-41e5-4b64-afeb-f24f1e2e1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Flow 'volume_create_manager' (de5d9aa6-18ad-481a-8041-c3dd9b8c2255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b68bc4ad-86b1-4806-abd6-d63c45eb357f tempest-SnapshotsActionsTest-1127389227 None] Created volume successfully.
Apr 24 01:12:42 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" returned: 0 in 0.795s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:42 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5
Apr 24 01:12:42 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Creating offline snapshot 8632bd6e-3a86-4553-98dd-7f719f58ff91 of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1673956-b80d-4814-942d-776e1974cf71]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:42 devstack sudo[87215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10
Apr 24 01:12:42 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:42 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "cinder-quobyte-28f10b24-0141-4f27-ad79-d2b0f9ac23b5" released by "delete_volume" :: held 1.372s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Created reservations ['1b6392a7-66bd-4981-b6b7-952faf6715a5', '2c66616b-e9e4-4167-8298-64a79c5abeaf', 'b95f3b2b-be09-4b57-88d6-356ac166551a', 'bb1aed21-e87a-4b7e-b954-1d0f1ab2ac95'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:42 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:42 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:43 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10" returned: 0 in 0.789s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:43 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 1G
Apr 24 01:12:43 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:43 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.949s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:43 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Deleted volume successfully.
Apr 24 01:12:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b2288d01-3090-45fb-99f9-88c14a15e1ee tempest-VolumesTransfersTest-649777823 None] Lock "cinder-28f10b24-0141-4f27-ad79-d2b0f9ac23b5-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:44 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 1G" returned: 0 in 1.182s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:44 devstack sudo[87230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:12:44 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Flow 'volume_create_manager' (2b2012ce-7d0b-4484-8339-d3556f157db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c655c9-3c83-421c-bea2-3225fce95b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c655c9-3c83-421c-bea2-3225fce95b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1792365995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c1544-b9f0-40b1-9143-54eebb956188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab1489211043e38543b2c7bbbb22d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:44Z,use_quota=True,user_id='8e74f2d0977d4d6cb3dbd7492c1b8777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5580c5-5928-40bc-9b11-31d8f5a151b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5580c5-5928-40bc-9b11-31d8f5a151b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b522ee9-0589-4660-8da5-200dd3353865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b522ee9-0589-4660-8da5-200dd3353865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16c1544-b9f0-40b1-9143-54eebb956188', 'volume_name': 'volume-a16c1544-b9f0-40b1-9143-54eebb956188', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1db41-5ccb-4df8-b3d8-cfa8afde6472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1db41-5ccb-4df8-b3d8-cfa8afde6472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9834e5-b909-4b88-ae4e-734a9a1e0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Volume a16c1544-b9f0-40b1-9143-54eebb956188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16c1544-b9f0-40b1-9143-54eebb956188', 'volume_size': 1}
Apr 24 01:12:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:45 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.841s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:45 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 is being set with open permissions: ugo+rw
Apr 24 01:12:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:45 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:12:45 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:45 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.588s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:45 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info
Apr 24 01:12:45 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:46 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info" returned: 0 in 0.619s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:46 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info is being set with open permissions: ugo+rw
Apr 24 01:12:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:46 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info
Apr 24 01:12:46 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:47 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.info" returned: 0 in 0.685s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.816s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1792365995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c1544-b9f0-40b1-9143-54eebb956188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab1489211043e38543b2c7bbbb22d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:44Z,use_quota=True,user_id='8e74f2d0977d4d6cb3dbd7492c1b8777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Creating volume a16c1544-b9f0-40b1-9143-54eebb956188 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:47 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:47 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 1073741824
Apr 24 01:12:47 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7913a448-dd93-49ef-8fef-b28606b0a565 tempest-SnapshotsActionsTest-1127389227 None] Create snapshot completed successfully
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Flow 'volume_create_manager' (4c11a4bb-56ca-4d10-af47-c0009be15722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbc9776-0321-4b5c-9a7f-415ef0a2b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbc9776-0321-4b5c-9a7f-415ef0a2b47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-346269289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715ad30-45a5-4282-9119-604ad41fb4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46b1a9fa1744c02ba1d4446e8199416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:48Z,use_quota=True,user_id='85380e2e9daa49dfb27069a8d6c34e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0457107-26b5-46bd-a904-616c8caf3c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0457107-26b5-46bd-a904-616c8caf3c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86674129-dae2-4f7b-8f56-8066e436800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86674129-dae2-4f7b-8f56-8066e436800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5715ad30-45a5-4282-9119-604ad41fb4a4', 'volume_name': 'volume-5715ad30-45a5-4282-9119-604ad41fb4a4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3df231-7b5e-4bf9-9638-dea61a4908d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3df231-7b5e-4bf9-9638-dea61a4908d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44be4a7f-0d0c-4597-9186-4d9daf358e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Volume 5715ad30-45a5-4282-9119-604ad41fb4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5715ad30-45a5-4282-9119-604ad41fb4a4', 'volume_size': 1}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:48 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 1073741824" returned: 0 in 1.058s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:48 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188
Apr 24 01:12:48 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:48 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188" returned: 0 in 0.554s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-346269289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715ad30-45a5-4282-9119-604ad41fb4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46b1a9fa1744c02ba1d4446e8199416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:48Z,use_quota=True,user_id='85380e2e9daa49dfb27069a8d6c34e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Creating volume 5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:48 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:48 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 1073741824
Apr 24 01:12:48 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9834e5-b909-4b88-ae4e-734a9a1e0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16c1544-b9f0-40b1-9143-54eebb956188', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc93a6e-0edd-4b75-ace6-919908387d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:48 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Volume volume-a16c1544-b9f0-40b1-9143-54eebb956188 (a16c1544-b9f0-40b1-9143-54eebb956188): created successfully
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc93a6e-0edd-4b75-ace6-919908387d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Flow 'volume_create_manager' (2b2012ce-7d0b-4484-8339-d3556f157db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d532b7b6-6eed-4687-93f5-4a2cface4158 tempest-VolumesTransfersTest-532603585 None] Created volume successfully.
Apr 24 01:12:49 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 1073741824" returned: 0 in 0.680s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:49 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:12:49 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:49 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.489s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.511s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44be4a7f-0d0c-4597-9186-4d9daf358e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5715ad30-45a5-4282-9119-604ad41fb4a4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290a3ab5-670f-4746-9cb0-d125a59af6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Creating offline snapshot 1aef6f5e-2c64-45a1-931a-42fa7ec607a9 of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:12:50 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Volume volume-5715ad30-45a5-4282-9119-604ad41fb4a4 (5715ad30-45a5-4282-9119-604ad41fb4a4): created successfully
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290a3ab5-670f-4746-9cb0-d125a59af6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Flow 'volume_create_manager' (4c11a4bb-56ca-4d10-af47-c0009be15722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c69367-c2b5-46a3-a973-01a1c160f5cc]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Acquiring lock "cinder-a16c1544-b9f0-40b1-9143-54eebb956188-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:50 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-064a2d4b-10f8-4231-a512-4421349157d3 tempest-VolumesCloneTest-1543286173 None] Created volume successfully.
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "cinder-a16c1544-b9f0-40b1-9143-54eebb956188-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Acquiring lock "cinder-quobyte-a16c1544-b9f0-40b1-9143-54eebb956188" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:50 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:12:50 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "cinder-quobyte-a16c1544-b9f0-40b1-9143-54eebb956188" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a508964c-d077-4b0b-b356-89fd318ba48c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:50 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188
Apr 24 01:12:50 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:50 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.748s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:50 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 1G
Apr 24 01:12:50 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:50 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188" returned: 0 in 0.663s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:51 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188
Apr 24 01:12:51 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:51 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a16c1544-b9f0-40b1-9143-54eebb956188" returned: 0 in 0.680s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "cinder-quobyte-a16c1544-b9f0-40b1-9143-54eebb956188" released by "delete_volume" :: held 1.384s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:51 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 1G" returned: 0 in 0.917s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:51 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9
Apr 24 01:12:51 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Flow 'volume_create_manager' (09ca9a77-d6e9-4653-bbff-c01c95e25370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912b1fbd-660c-44b6-b178-446341ec88dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Created reservations ['d3878259-781e-4319-bd9f-fdc7c0be684b', '909126fd-a32f-4eeb-a731-e180e6d75d05', 'e3d86015-0e5e-497e-b334-67b4159758f8', '31937469-e827-43ee-83de-031b36425fa3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Flow 'volume_create_manager' (63d4edf1-fe5a-48fb-beab-73b290a680b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4502f424-aa36-4288-91f5-298784132029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4502f424-aa36-4288-91f5-298784132029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568990045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4934bdc7-eec0-4ffd-9a03-054f699ac047,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acf5993ab09b4f5aa2bbc4f4abf3e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:52Z,use_quota=True,user_id='8e3f518b05a549088959eb995c2fd1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e90a8f-c4ab-4293-b665-889c2a80f56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e90a8f-c4ab-4293-b665-889c2a80f56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687786bd-972c-4cda-9783-77dd2fa78b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687786bd-972c-4cda-9783-77dd2fa78b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4934bdc7-eec0-4ffd-9a03-054f699ac047', 'volume_name': 'volume-4934bdc7-eec0-4ffd-9a03-054f699ac047', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f1bdd5-b09a-474b-8495-dac3f44036df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f1bdd5-b09a-474b-8495-dac3f44036df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17add705-bf30-4f84-a1b6-442f5cb978a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Volume 4934bdc7-eec0-4ffd-9a03-054f699ac047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4934bdc7-eec0-4ffd-9a03-054f699ac047', 'volume_size': 1}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912b1fbd-660c-44b6-b178-446341ec88dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-474187443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2469ff22-f256-4165-84cf-5255e02e2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46b1a9fa1744c02ba1d4446e8199416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=5715ad30-45a5-4282-9119-604ad41fb4a4,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:52Z,use_quota=True,user_id='85380e2e9daa49dfb27069a8d6c34e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492b8206-6ba1-4fd7-bd04-a42caf36b263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492b8206-6ba1-4fd7-bd04-a42caf36b263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9c122-7676-426d-b35b-a227d821cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9c122-7676-426d-b35b-a227d821cae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2469ff22-f256-4165-84cf-5255e02e2578', 'volume_name': 'volume-2469ff22-f256-4165-84cf-5255e02e2578', 'volume_size': 2, 'source_volid': '5715ad30-45a5-4282-9119-604ad41fb4a4', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6829e960-abec-49c5-80a8-8879dd850d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6829e960-abec-49c5-80a8-8879dd850d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d432abd9-d276-43e1-b3da-08983960436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:52 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Volume 2469ff22-f256-4165-84cf-5255e02e2578: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2469ff22-f256-4165-84cf-5255e02e2578', 'volume_size': 2, 'source_volid': '5715ad30-45a5-4282-9119-604ad41fb4a4', 'source_volstatus': 'available'}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:52 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:52 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:52 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9" returned: 0 in 0.617s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:52 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 is being set with open permissions: ugo+rw
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:52 devstack sudo[87295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9
Apr 24 01:12:52 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:52 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.484s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Deleted volume successfully.
Apr 24 01:12:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39276805-0e17-41a4-88e9-343517a7dd11 tempest-VolumesTransfersTest-649777823 None] Lock "cinder-a16c1544-b9f0-40b1-9143-54eebb956188-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:53 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9" returned: 0 in 0.581s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568990045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4934bdc7-eec0-4ffd-9a03-054f699ac047,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acf5993ab09b4f5aa2bbc4f4abf3e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:52Z,use_quota=True,user_id='8e3f518b05a549088959eb995c2fd1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Creating volume 4934bdc7-eec0-4ffd-9a03-054f699ac047 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:12:53 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:53 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 1073741824
Apr 24 01:12:53 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0ff440c4-f2e0-400e-a2ae-80d6ed935cbb tempest-SnapshotsActionsTest-1127389227 None] Create snapshot completed successfully
Apr 24 01:12:53 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 1073741824" returned: 0 in 0.834s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-1aef6f5e-2c64-45a1-931a-42fa7ec607a9-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:53 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047
Apr 24 01:12:53 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-1aef6f5e-2c64-45a1-931a-42fa7ec607a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-1aef6f5e-2c64-45a1-931a-42fa7ec607a9" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-1aef6f5e-2c64-45a1-931a-42fa7ec607a9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Deleting offline snapshot 1aef6f5e-2c64-45a1-931a-42fa7ec607a9 of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] snapshot_file for this snap is: volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[310e4b1f-b658-4aaf-8850-59aff2a102ef]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:54 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9
Apr 24 01:12:54 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:54 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047" returned: 0 in 0.576s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.451s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:54 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Cloning volume 5715ad30-45a5-4282-9119-604ad41fb4a4 to volume 2469ff22-f256-4165-84cf-5255e02e2578
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17add705-bf30-4f84-a1b6-442f5cb978a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4934bdc7-eec0-4ffd-9a03-054f699ac047', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9505983a-87cd-4d62-b123-ee6070f02cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:12:54 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Volume volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 (4934bdc7-eec0-4ffd-9a03-054f699ac047): created successfully
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9505983a-87cd-4d62-b123-ee6070f02cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Flow 'volume_create_manager' (63d4edf1-fe5a-48fb-beab-73b290a680b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Creating offline snapshot 9f9e0327-a934-4c93-8159-969bcdd89b53 of volume 5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:12:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-3d49b560-28a1-481e-af08-ba9a4197cb19 req-68e58c2e-b45b-450d-aa8f-19a2b3e93dd5 tempest-VolumesGetTestJSON-1305059173 None] Created volume successfully.
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d551acac-881e-4acd-ab9e-490e55646f03]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:54 devstack sudo[87311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:12:54 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:54 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9" returned: 0 in 0.781s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a01203-45b6-4c33-81eb-d666003b669c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:55 devstack sudo[87316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:12:55 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:55 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.777s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:55 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 1G
Apr 24 01:12:55 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Acquiring lock "cinder-4934bdc7-eec0-4ffd-9a03-054f699ac047-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "cinder-4934bdc7-eec0-4ffd-9a03-054f699ac047-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Acquiring lock "cinder-quobyte-4934bdc7-eec0-4ffd-9a03-054f699ac047" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "cinder-quobyte-4934bdc7-eec0-4ffd-9a03-054f699ac047" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489f1ba-95c3-4e3d-b66a-1bd20e72cfc5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:55 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.898s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:12:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:55 devstack sudo[87327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9
Apr 24 01:12:55 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:55 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047
Apr 24 01:12:55 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:56 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 1G" returned: 0 in 0.970s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5715ad30-45a5-4282-9119-604ad41fb4a4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:56 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5715ad30-45a5-4282-9119-604ad41fb4a4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:12:56 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:56 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047" returned: 0 in 0.892s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:56 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047
Apr 24 01:12:56 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:56 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9" returned: 0 in 0.893s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:56 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9
Apr 24 01:12:56 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:56 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5715ad30-45a5-4282-9119-604ad41fb4a4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.635s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:56 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 is being set with open permissions: ugo+rw
Apr 24 01:12:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:57 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:12:57 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:57 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.1aef6f5e-2c64-45a1-931a-42fa7ec607a9" returned: 0 in 0.633s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:57 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-1aef6f5e-2c64-45a1-931a-42fa7ec607a9" released by "_delete_snapshot" :: held 3.360s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4934bdc7-eec0-4ffd-9a03-054f699ac047" returned: 0 in 0.722s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "cinder-quobyte-4934bdc7-eec0-4ffd-9a03-054f699ac047" released by "delete_volume" :: held 1.662s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_snapshot" :: held 3.415s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.quota [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Created reservations ['c0141204-6371-450d-84d7-6f24dcdc1ac9', 'b0b93c3b-c5c5-4850-888e-6f55914f077c', '07328580-1806-4a1f-a03f-00b605bf66a3', 'b7c79c55-254e-44f6-ab33-5b830e70a6f7'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:57 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Created reservations ['49799381-3c75-4e18-87fb-9910e164e706', '58e585d9-1576-4503-a6a7-adfb110886cc', 'eeff9df3-a07e-4112-978a-78065a9aa27e', 'bf60ca9f-036b-452c-b022-832846972d4f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:57 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info
Apr 24 01:12:57 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:57 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:12:57 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Delete snapshot completed successfully.
Apr 24 01:12:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7d74560f-26f1-4548-9420-63cca615a290 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-1aef6f5e-2c64-45a1-931a-42fa7ec607a9-delete_snapshot" released by "delete_snapshot" :: held 3.737s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:58 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info" returned: 0 in 0.627s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:58 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info is being set with open permissions: ugo+rw
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:58 devstack sudo[87359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info
Apr 24 01:12:58 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:58 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.650s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.manager [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:12:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Deleted volume successfully.
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [req-cb91413e-c82f-4e9f-90f7-60e83aca4bdd req-491187ff-2b07-42a6-8039-3a5bafdff2f6 tempest-VolumesGetTestJSON-1305059173 None] Lock "cinder-4934bdc7-eec0-4ffd-9a03-054f699ac047-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:58 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.info" returned: 0 in 0.604s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] snapshot: 9f9e0327-a934-4c93-8159-969bcdd89b53, volume: 2469ff22-f256-4165-84cf-5255e02e2578,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0b315-2371-416a-963c-57b1a23ac9c8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:59 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:12:59 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:12:59 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.744s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5715ad30-45a5-4282-9119-604ad41fb4a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[500018f6-47fb-4629-996c-c0fc80e93696]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:12:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:12:59 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:12:59 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:00 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.744s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:00 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:13:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:00 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578
Apr 24 01:13:00 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Flow 'volume_create_manager' (0d280c22-9feb-4ffb-8a84-84524eaa9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d23eb8-e66c-48f9-b9d3-9847a71ad1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d23eb8-e66c-48f9-b9d3-9847a71ad1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1608113137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09a831d-d447-440e-b32f-586fc1e3ae7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7455acecad48a483d61827cc7806a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:01Z,use_quota=True,user_id='0842cc930b234ce789345a17553960c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64c39dc-a9f3-4f18-9c1e-0390fdc00c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64c39dc-a9f3-4f18-9c1e-0390fdc00c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede45f0-b0d4-46ae-96b3-4f50e9b2361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede45f0-b0d4-46ae-96b3-4f50e9b2361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09a831d-d447-440e-b32f-586fc1e3ae7c', 'volume_name': 'volume-c09a831d-d447-440e-b32f-586fc1e3ae7c', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bf7f3-fd5b-443c-82ef-c15487aaf590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bf7f3-fd5b-443c-82ef-c15487aaf590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c6be2a-7f4b-4e7f-afb8-518ab5faedb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:01 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Volume c09a831d-d447-440e-b32f-586fc1e3ae7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09a831d-d447-440e-b32f-586fc1e3ae7c', 'volume_size': 1}
Apr 24 01:13:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:06 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578" returned: 0 in 6.273s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:06 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe619b-aa4b-4423-a4e9-b4c05bd99021]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:06 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:13:06 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:07 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.860s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:07 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:13:07 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Converted 1024.00 MB image at 163.18 MB/s
Apr 24 01:13:07 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 is being set with open permissions: ugo+rw
Apr 24 01:13:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:07 devstack sudo[87396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578
Apr 24 01:13:07 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:08 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578" returned: 0 in 0.560s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" released by "_copy_volume_from_snapshot" :: held 9.332s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-quobyte-9f9e0327-a934-4c93-8159-969bcdd89b53" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-9f9e0327-a934-4c93-8159-969bcdd89b53" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Deleting offline snapshot 9f9e0327-a934-4c93-8159-969bcdd89b53 of volume 5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] snapshot_file for this snap is: volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee60bd9a-c795-4434-8684-d9f6f454684d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:08 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:13:08 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f9ada744-dc14-499e-859e-ba93faa91c5d tempest-GroupSnapshotsV319Test-561075851 None] Group tempest-GroupSnapshotsV319Test-Group-949603065: creating
Apr 24 01:13:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f9ada744-dc14-499e-859e-ba93faa91c5d tempest-GroupSnapshotsV319Test-561075851 None] Group tempest-GroupSnapshotsV319Test-Group-949603065: created successfully
Apr 24 01:13:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f9ada744-dc14-499e-859e-ba93faa91c5d tempest-GroupSnapshotsV319Test-561075851 None] Create group completed successfully.
Apr 24 01:13:08 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.603s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5715ad30-45a5-4282-9119-604ad41fb4a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd65dd50-84b7-4a87-9279-9620988a3c06]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:09 devstack sudo[87404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:13:09 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:09 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.536s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:09 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:13:09 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:10 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.577s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:10 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53
Apr 24 01:13:10 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Flow 'volume_create_manager' (f90bdd35-1787-4ae0-89c8-74d3a389f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca23c509-85f7-4eb1-a0b0-e42f7ba91439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca23c509-85f7-4eb1-a0b0-e42f7ba91439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1335365543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f04be994-0918-41fd-8aa4-7ec48a7ed4b7,host='devstack@QuobyteHD#QuobyteHD',id=4471b4b0-e3c3-42a0-8d9d-67bed6428dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e09f061d6de4b74bd186bcd052fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:10Z,use_quota=True,user_id='6f4facb276fc4341a6de99f153907c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8665c5-c2e2-4075-99ae-d32e73cfdce2),volume_type_id=6c8665c5-c2e2-4075-99ae-d32e73cfdce2)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a0f47c-36e1-497e-b3ab-9691430809d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a0f47c-36e1-497e-b3ab-9691430809d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef58415-9e84-453c-bd04-4602dcfd8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef58415-9e84-453c-bd04-4602dcfd8406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4471b4b0-e3c3-42a0-8d9d-67bed6428dd4', 'volume_name': 'volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873cac0-e14a-463d-8053-4fd508969b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873cac0-e14a-463d-8053-4fd508969b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41859604-55aa-4006-8b8d-e4675efb2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Volume 4471b4b0-e3c3-42a0-8d9d-67bed6428dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4', 'volume_size': 1}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:10 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4.9f9e0327-a934-4c93-8159-969bcdd89b53" returned: 0 in 0.533s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-9f9e0327-a934-4c93-8159-969bcdd89b53" released by "_delete_snapshot" :: held 2.368s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.172s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.979s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d432abd9-d276-43e1-b3da-08983960436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2469ff22-f256-4165-84cf-5255e02e2578', 'volume_size': 2, 'source_volid': '5715ad30-45a5-4282-9119-604ad41fb4a4', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0150497-441a-471b-806d-147f31af11ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Creating offline snapshot 619de2ca-6ff6-4fce-b827-1230d35aa2bd of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:13:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Volume volume-2469ff22-f256-4165-84cf-5255e02e2578 (2469ff22-f256-4165-84cf-5255e02e2578): created successfully
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0150497-441a-471b-806d-147f31af11ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Flow 'volume_create_manager' (09ca9a77-d6e9-4653-bbff-c01c95e25370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a4d96-c0a6-4f3a-8a4f-ec99971aaf38]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f84f2e0d-766a-471a-99f3-ac00a4b31ac8 tempest-VolumesCloneTest-1543286173 None] Created volume successfully.
Apr 24 01:13:10 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:10 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:11 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.592s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:11 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd 1G
Apr 24 01:13:11 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-2469ff22-f256-4165-84cf-5255e02e2578-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-2469ff22-f256-4165-84cf-5255e02e2578-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=103,cinder:INSERT=32,cinder:UPDATE=122,cinder:DELETE=4 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=78,cinder:UPDATE=104,cinder:INSERT=20,cinder:DELETE=13 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[253e3d8a-c055-4213-bd25-6ab29c8d7dac]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:11 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578
Apr 24 01:13:11 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:12 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd 1G" returned: 0 in 0.759s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:12 devstack sudo[87429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd
Apr 24 01:13:12 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:12 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:12 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578
Apr 24 01:13:12 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:12 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd" returned: 0 in 0.537s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:12 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd is being set with open permissions: ugo+rw
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:12 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd
Apr 24 01:13:12 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:12 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2469ff22-f256-4165-84cf-5255e02e2578" returned: 0 in 0.548s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-2469ff22-f256-4165-84cf-5255e02e2578" released by "delete_volume" :: held 1.248s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:12 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Created reservations ['144cd84d-7db9-43e3-9d0b-c36c9dfd9d2f', 'b10728ea-4a6c-439f-a84f-b60421dd634e', '8ff9c0f6-8f80-4b04-9f75-1a538185258d', 'db6a4282-f7dc-4d2f-b39c-a04cf565a8e3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:13 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:13 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:13 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd" returned: 0 in 0.509s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.966s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1608113137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09a831d-d447-440e-b32f-586fc1e3ae7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7455acecad48a483d61827cc7806a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:01Z,use_quota=True,user_id='0842cc930b234ce789345a17553960c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Creating volume c09a831d-d447-440e-b32f-586fc1e3ae7c {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:13 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c 1073741824
Apr 24 01:13:13 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-170b90b0-1ee0-4dd2-874c-c1a5f219cf45 tempest-SnapshotsActionsTest-1127389227 None] Create snapshot completed successfully
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-619de2ca-6ff6-4fce-b827-1230d35aa2bd-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-619de2ca-6ff6-4fce-b827-1230d35aa2bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-619de2ca-6ff6-4fce-b827-1230d35aa2bd" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-619de2ca-6ff6-4fce-b827-1230d35aa2bd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Deleting offline snapshot 619de2ca-6ff6-4fce-b827-1230d35aa2bd of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] snapshot_file for this snap is: volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[9066b81e-08fe-4c2d-b3c1-d6ad4cbcdbee]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:13 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.641s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Deleted volume successfully.
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9ecac3e2-44b7-4c9d-bfdc-ca26b2aa0d06 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-2469ff22-f256-4165-84cf-5255e02e2578-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:13 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd
Apr 24 01:13:13 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-5715ad30-45a5-4282-9119-604ad41fb4a4-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-5715ad30-45a5-4282-9119-604ad41fb4a4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "cinder-quobyte-5715ad30-45a5-4282-9119-604ad41fb4a4" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-5715ad30-45a5-4282-9119-604ad41fb4a4" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a1393-f2c7-4783-9da5-14d0b0e1c45d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:14 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c 1073741824" returned: 0 in 0.888s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:14 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c
Apr 24 01:13:14 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:14 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:13:14 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:14 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd" returned: 0 in 0.720s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b940035-215f-4723-a8d6-613559486f80]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:14 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:14 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:14 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c" returned: 0 in 0.556s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.392s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f04be994-0918-41fd-8aa4-7ec48a7ed4b7,created_at=2026-04-23T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1335365543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f04be994-0918-41fd-8aa4-7ec48a7ed4b7,host='devstack@QuobyteHD#QuobyteHD',id=4471b4b0-e3c3-42a0-8d9d-67bed6428dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e09f061d6de4b74bd186bcd052fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:10Z,use_quota=True,user_id='6f4facb276fc4341a6de99f153907c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8665c5-c2e2-4075-99ae-d32e73cfdce2),volume_type_id=6c8665c5-c2e2-4075-99ae-d32e73cfdce2)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Creating volume 4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:14 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c6be2a-7f4b-4e7f-afb8-518ab5faedb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09a831d-d447-440e-b32f-586fc1e3ae7c', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:14 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 1073741824
Apr 24 01:13:14 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7031b313-6714-4921-a68b-0490f791e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:14 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:14 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Volume volume-c09a831d-d447-440e-b32f-586fc1e3ae7c (c09a831d-d447-440e-b32f-586fc1e3ae7c): created successfully
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7031b313-6714-4921-a68b-0490f791e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Flow 'volume_create_manager' (0d280c22-9feb-4ffb-8a84-84524eaa9d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.706s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:14 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d272dff5-43fb-4cb3-aa1b-24ffb467c894 tempest-VolumesTransfersV355Test-1329913165 None] Created volume successfully.
Apr 24 01:13:14 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4
Apr 24 01:13:14 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:15 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.735s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:15 devstack sudo[87476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd
Apr 24 01:13:15 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:15 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 1073741824" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:15 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4
Apr 24 01:13:15 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:15 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5715ad30-45a5-4282-9119-604ad41fb4a4" returned: 0 in 0.679s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-quobyte-5715ad30-45a5-4282-9119-604ad41fb4a4" released by "delete_volume" :: held 1.454s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Created reservations ['7f86c2c6-ed95-4d34-afd9-e4d28b8e159c', '95b0ad58-13c0-4fdb-927f-20d5bb28fad3', '41a2d444-39b5-4884-bbc9-5bb18914c2a7', 'a0a87c30-0c06-49a0-8142-7cf2a2c5bde5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:15 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:15 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:16 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd" returned: 0 in 1.018s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:16 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" returned: 0 in 0.735s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:16 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd
Apr 24 01:13:16 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41859604-55aa-4006-8b8d-e4675efb2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad93d2e5-fd36-4701-aea1-3186758577c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:16 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Volume volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 (4471b4b0-e3c3-42a0-8d9d-67bed6428dd4): created successfully
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad93d2e5-fd36-4701-aea1-3186758577c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Flow 'volume_create_manager' (f90bdd35-1787-4ae0-89c8-74d3a389f68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-80cb6a0c-0cd6-4b2f-a8c5-65878ca53382 tempest-GroupSnapshotsV319Test-561075851 None] Created volume successfully.
Apr 24 01:13:16 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Deleted volume successfully.
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d43953a-490e-4153-9838-bcb04ef5c448 tempest-VolumesCloneTest-1543286173 None] Lock "cinder-5715ad30-45a5-4282-9119-604ad41fb4a4-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-cbe39dbb-79c4-4d4e-9b2f-e6bfda77a6ed tempest-VolumesTransfersV355Test-2096515320 None] Transfer volume completed successfully.
Apr 24 01:13:16 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.619de2ca-6ff6-4fce-b827-1230d35aa2bd" returned: 0 in 0.637s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-619de2ca-6ff6-4fce-b827-1230d35aa2bd" released by "_delete_snapshot" :: held 3.211s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_snapshot" :: held 3.243s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:16 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Created reservations ['df7232b1-855d-42b4-8bb8-38e5ae1a7406', '5f16eeea-f6c7-4a0f-b2e5-ac0a3c773ddd', 'ed6468c9-aa06-4343-b3dd-fa94e91a4464', '94326ceb-59e3-4784-a9f7-3f98d3616c5b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Delete snapshot completed successfully.
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bf7d95bb-4921-4485-96e0-02e9d7500a05 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-619de2ca-6ff6-4fce-b827-1230d35aa2bd-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] GroupSnapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: creating.
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Group snapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: creating. {{(pid=81902) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Creating offline snapshot 8b7ea35a-86a0-4e1e-a569-13a7615cc805 of volume 4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf626f98-d04f-4273-9d19-a3a0ee7a9896]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:17 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4
Apr 24 01:13:17 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "cinder-c09a831d-d447-440e-b32f-586fc1e3ae7c-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-c09a831d-d447-440e-b32f-586fc1e3ae7c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "cinder-quobyte-c09a831d-d447-440e-b32f-586fc1e3ae7c" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-quobyte-c09a831d-d447-440e-b32f-586fc1e3ae7c" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2098a1-a266-49e3-9dd2-67e366f610be]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:18 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c
Apr 24 01:13:18 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:18 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" returned: 0 in 0.772s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:18 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 1G
Apr 24 01:13:18 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:18 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c" returned: 0 in 0.860s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:18 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c
Apr 24 01:13:18 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:18 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 1G" returned: 0 in 0.803s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:19 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805
Apr 24 01:13:19 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:19 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:19 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:19 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c09a831d-d447-440e-b32f-586fc1e3ae7c" returned: 0 in 0.642s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-quobyte-c09a831d-d447-440e-b32f-586fc1e3ae7c" released by "delete_volume" :: held 1.601s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Created reservations ['4a3b222d-9494-4d0f-91c9-61f1fd74d21a', '56f95836-f317-4fa4-9733-618a71f7766c', '450c3496-52b1-42c5-9e5d-9cbd523ca744', '60b4aec4-f137-4c67-bdad-03209e95a9d9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:19 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805" returned: 0 in 0.622s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:19 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:19 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805
Apr 24 01:13:19 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:19 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:19 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:20 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.671s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Flow 'volume_create_manager' (b8c55d58-6645-4972-b1f6-3e5fcf73eb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0831bb31-340d-402b-8a33-282244297396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0831bb31-340d-402b-8a33-282244297396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-408931064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34a8f89-e3a6-417d-8731-838d1202615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8d0f9045e4236b95256259d22e6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:20Z,use_quota=True,user_id='7b333d0926e44605b630d954493780b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75830800-7763-4e4e-a582-199d79e9ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75830800-7763-4e4e-a582-199d79e9ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7b0367-7344-4f0a-877b-9a6a16815ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.image.glance [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Creating Keystone auth plugin from conf {{(pid=81902) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805" returned: 0 in 0.681s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:20 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info
Apr 24 01:13:20 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:20 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.783s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:20 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Deleted volume successfully.
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-48f0f06b-fec7-4543-9b7e-eeb24e02a19c tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-c09a831d-d447-440e-b32f-586fc1e3ae7c-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Flow 'volume_create_manager' (515189f4-06ac-4ebf-bf4b-91cfc6fcd285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02112eb9-749f-4635-bf11-5cd201e1efd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02112eb9-749f-4635-bf11-5cd201e1efd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2070076921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7474606c-13b2-44d8-bfd7-8abd017d7d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7455acecad48a483d61827cc7806a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:21Z,use_quota=True,user_id='0842cc930b234ce789345a17553960c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad2ec0-e507-48f1-aade-414b3aafcc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad2ec0-e507-48f1-aade-414b3aafcc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d839dd82-1a70-4fc1-80bf-2b5f4a51bcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d839dd82-1a70-4fc1-80bf-2b5f4a51bcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7474606c-13b2-44d8-bfd7-8abd017d7d5d', 'volume_name': 'volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fa964b-a34f-428f-9a68-ed8077df14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fa964b-a34f-428f-9a68-ed8077df14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64037d89-6e4c-4f9c-b842-756684bba101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Volume 7474606c-13b2-44d8-bfd7-8abd017d7d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d', 'volume_size': 1}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7b0367-7344-4f0a-877b-9a6a16815ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd34a8f89-e3a6-417d-8731-838d1202615a', 'volume_name': 'volume-d34a8f89-e3a6-417d-8731-838d1202615a', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500ba2f0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e02c94-2b89-42b6-b74f-fc33134cb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e02c94-2b89-42b6-b74f-fc33134cb73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f36f1d8-9601-4a16-bb56-24ac31beacbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Volume d34a8f89-e3a6-417d-8731-838d1202615a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d34a8f89-e3a6-417d-8731-838d1202615a', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500ba2f0>}
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Trying to clone d34a8f89-e3a6-417d-8731-838d1202615a from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]). {{(pid=81902) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 01:13:20 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info" returned: 0 in 0.665s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:20 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 01:13:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:21 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info
Apr 24 01:13:21 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 01:13:21 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b0073-d58c-4d00-b812-b361b5510dc2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:21 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD
Apr 24 01:13:21 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:21 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.info" returned: 0 in 0.497s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.216s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Creating offline snapshot a496fe62-804f-4df9-bf6c-146fb95fb88a of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d6571-b03c-444f-a664-0ce209c365a4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:21 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a4de8b63-a8ae-4c54-87ee-7a5f84a3b216 tempest-GroupSnapshotsV319Test-561075851 None] group_snapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: created successfully
Apr 24 01:13:21 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 is fetched for user 7b333d0926e44605b630d954493780b6. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 01:13:21 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:21 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd30ad95-2701-450d-a833-a0f26d855016]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:21 devstack sudo[87539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD
Apr 24 01:13:21 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:22 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.539s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:22 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a 1G
Apr 24 01:13:22 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:22 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:22 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a 1G" returned: 0 in 0.699s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:22 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a
Apr 24 01:13:22 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] group_snapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: deleting
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] group_snapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: deleting {{(pid=81902) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "cinder-quobyte-8b7ea35a-86a0-4e1e-a569-13a7615cc805" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-8b7ea35a-86a0-4e1e-a569-13a7615cc805" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Deleting offline snapshot 8b7ea35a-86a0-4e1e-a569-13a7615cc805 of volume 4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] snapshot_file for this snap is: volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e05d5-a4b7-488f-a45a-517c39f84c92]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:23 devstack sudo[87555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805
Apr 24 01:13:23 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:23 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a" returned: 0 in 0.598s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:23 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a is being set with open permissions: ugo+rw
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:23 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a
Apr 24 01:13:23 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:23 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a" returned: 0 in 0.441s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:23 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805" returned: 0 in 0.664s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8881a3-ecf7-472e-a516-6c238d9c537a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.308s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2070076921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7474606c-13b2-44d8-bfd7-8abd017d7d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7455acecad48a483d61827cc7806a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:21Z,use_quota=True,user_id='0842cc930b234ce789345a17553960c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Creating volume 7474606c-13b2-44d8-bfd7-8abd017d7d5d {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:23 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:23 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d 1073741824
Apr 24 01:13:23 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4d2aadba-4665-4167-83a7-18c28f08864d tempest-SnapshotsActionsTest-1127389227 None] Create snapshot completed successfully
Apr 24 01:13:24 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4
Apr 24 01:13:24 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:24 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" returned: 0 in 0.617s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:24 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805
Apr 24 01:13:24 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:24 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d 1073741824" returned: 0 in 0.719s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-a496fe62-804f-4df9-bf6c-146fb95fb88a-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:24 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d
Apr 24 01:13:24 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-a496fe62-804f-4df9-bf6c-146fb95fb88a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-a496fe62-804f-4df9-bf6c-146fb95fb88a" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-a496fe62-804f-4df9-bf6c-146fb95fb88a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Deleting offline snapshot a496fe62-804f-4df9-bf6c-146fb95fb88a of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] snapshot_file for this snap is: volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f986168-2012-476c-97bb-7d67eecb7ac4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:24 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a
Apr 24 01:13:24 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:25 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805" returned: 0 in 0.663s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:25 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d" returned: 0 in 0.522s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:25 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805
Apr 24 01:13:25 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.999s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-408931064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34a8f89-e3a6-417d-8731-838d1202615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8d0f9045e4236b95256259d22e6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:20Z,use_quota=True,user_id='7b333d0926e44605b630d954493780b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Creating volume d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:25 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:25 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1073741824
Apr 24 01:13:25 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64037d89-6e4c-4f9c-b842-756684bba101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2fcfc3-7326-46dc-b710-71cb69dc79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Volume volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d (7474606c-13b2-44d8-bfd7-8abd017d7d5d): created successfully
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2fcfc3-7326-46dc-b710-71cb69dc79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Flow 'volume_create_manager' (515189f4-06ac-4ebf-bf4b-91cfc6fcd285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-353ac0c8-854f-4048-90d3-29932d34307b tempest-VolumesTransfersV355Test-1329913165 None] Created volume successfully.
Apr 24 01:13:25 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a" returned: 0 in 0.653s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[954da953-9bfc-41e1-bbcf-80a4a544d11b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:25 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:25 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:25 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4.8b7ea35a-86a0-4e1e-a569-13a7615cc805" returned: 0 in 0.538s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-8b7ea35a-86a0-4e1e-a569-13a7615cc805" released by "_delete_snapshot" :: held 2.653s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" released by "delete_snapshot" :: held 2.682s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:25 devstack cinder-volume[81902]: WARNING cinder.quota [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-715307392 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-715307392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:13:25 devstack cinder-volume[81902]: WARNING cinder.quota [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-715307392 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-715307392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:13:25 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] Created reservations ['7370ac00-d371-4abf-abe9-ed4da988547f', '5962ef65-9bef-44cd-82e2-9a4ad21e963e', '131df674-4576-43a7-a594-8e83236be01b', '2c78c456-7a27-4e55-b2d0-d4a7461d268f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:26 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-cee19be5-07a2-491d-bf22-04d4c20c6313 tempest-GroupSnapshotsV319Test-561075851 None] group_snapshot b2dea402-4fce-4fe1-8a9f-2db09b3fe855: deleted successfully
Apr 24 01:13:26 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1073741824" returned: 0 in 0.840s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:26 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:26 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:26 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.708s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:26 devstack sudo[87604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a
Apr 24 01:13:26 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "cinder-7474606c-13b2-44d8-bfd7-8abd017d7d5d-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-7474606c-13b2-44d8-bfd7-8abd017d7d5d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "cinder-quobyte-7474606c-13b2-44d8-bfd7-8abd017d7d5d" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-quobyte-7474606c-13b2-44d8-bfd7-8abd017d7d5d" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5408da5-e59c-48f8-bcd6-d2cfcd24ea82]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:26 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d
Apr 24 01:13:26 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:26 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 0.643s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91b886e-6fff-4568-bfb9-5205d19d4a41]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Attempting download of fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume d34a8f89-e3a6-417d-8731-838d1202615a. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8ae18-7fc3-40b6-a479-3c7b270f3dd3]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:26 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4
Apr 24 01:13:26 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a" returned: 0 in 0.803s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:27 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl
Apr 24 01:13:27 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a
Apr 24 01:13:27 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d" returned: 0 in 0.834s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:27 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d
Apr 24 01:13:27 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" returned: 0 in 0.688s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:27 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4
Apr 24 01:13:27 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.a496fe62-804f-4df9-bf6c-146fb95fb88a" returned: 0 in 0.556s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-a496fe62-804f-4df9-bf6c-146fb95fb88a" released by "_delete_snapshot" :: held 2.818s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_snapshot" :: held 2.841s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Created reservations ['429ea9ac-156a-464b-8788-917b00db9623', 'd2df0d72-1d08-4707-a726-e2432a471353', 'bcb62495-94d7-4412-9e64-cc2b744b2c36', 'ee7f25fe-393c-4fc9-971b-1b10a4353665'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:27 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl" returned: 0 in 0.785s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Delete snapshot completed successfully.
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19a2dcd9-0674-4996-b184-05e30d733191 tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-a496fe62-804f-4df9-bf6c-146fb95fb88a-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:27 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl
Apr 24 01:13:27 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:27 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7474606c-13b2-44d8-bfd7-8abd017d7d5d" returned: 0 in 0.639s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-quobyte-7474606c-13b2-44d8-bfd7-8abd017d7d5d" released by "delete_volume" :: held 1.521s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:27 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Created reservations ['d6301577-909e-4a75-92b0-22185aeebb10', 'd82fc43c-2aaa-4d7b-a27e-d96ea08285db', '48a9ccca-bf8d-4102-a729-785206b66057', '4e453005-028c-427b-a113-b3535c394695'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:28 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" returned: 0 in 0.675s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:28 devstack sudo[87635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:28 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Lock "cinder-quobyte-4471b4b0-e3c3-42a0-8d9d-67bed6428dd4" released by "delete_volume" :: held 1.437s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Created reservations ['e569dc77-0638-425e-a15a-4a4d00773eb3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:28 devstack cinder-volume[81902]: WARNING cinder.quota [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-715307392 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-715307392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Created reservations ['284f38c9-7223-4325-90eb-0e8e00e4cc87', 'bf2de928-83e6-4a34-8a98-64424e1eed37', 'd576bffa-7e31-456f-a52f-358e752c0eea', '689f67cf-0cc8-4be1-9099-96e8068fdfe9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Creating offline snapshot 9ada7241-d28f-460c-bc56-600cf0d709ea of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:13:28 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl" returned: 1 in 0.885s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_xpz5qlvl' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae5c348-1171-47b8-8ab2-7e4d5f1dfdc4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eee2db-5786-4618-b907-151915d5f9d3]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:28 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD
Apr 24 01:13:28 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:28 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:28 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:28 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:28 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:28 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.725s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Deleted volume successfully.
Apr 24 01:13:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-698953c5-ffda-4949-adf4-932a57e87cc4 tempest-VolumesTransfersV355Test-1053177912 None] Lock "cinder-7474606c-13b2-44d8-bfd7-8abd017d7d5d-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:29 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] fbaaf1b8-b24b-4256-a358-443af08ba5c6 was qcow2, converting to raw {{(pid=81902) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:29 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.830s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:29 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:29 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9f14958e-ba18-4f05-9dcd-a4b424d881a1 tempest-GroupSnapshotsV319Test-561075851 None] Delete group completed successfully.
Apr 24 01:13:29 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 1.049s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:29 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea 1G
Apr 24 01:13:29 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:30 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea 1G" returned: 0 in 1.126s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:30 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea
Apr 24 01:13:30 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:31 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea" returned: 0 in 0.875s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:31 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea is being set with open permissions: ugo+rw
Apr 24 01:13:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:31 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea
Apr 24 01:13:31 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:31 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 2.215s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:31 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_e_82zh0ddevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:13:31 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Converted 112.00 MB image at 50.53 MB/s
Apr 24 01:13:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:31 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1G
Apr 24 01:13:31 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:32 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea" returned: 0 in 0.754s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f50751ae-ca09-4856-a9a8-59f1a951457c tempest-SnapshotsActionsTest-1127389227 None] Create snapshot completed successfully
Apr 24 01:13:32 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 1G" returned: 0 in 0.870s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b265cd-39b2-4d7b-b48f-03c32e29db25]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:32 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:32 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-9ada7241-d28f-460c-bc56-600cf0d709ea-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-9ada7241-d28f-460c-bc56-600cf0d709ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Acquiring lock "cinder-quobyte-9ada7241-d28f-460c-bc56-600cf0d709ea" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-9ada7241-d28f-460c-bc56-600cf0d709ea" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Deleting offline snapshot 9ada7241-d28f-460c-bc56-600cf0d709ea of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] snapshot_file for this snap is: volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423bd5e-918c-4ed6-aac7-f2a410e902bd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:33 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea
Apr 24 01:13:33 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:33 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 1.153s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:33 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:33 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:34 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea" returned: 0 in 0.926s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7a9463-e5f9-42eb-8ce6-28a00da3d3d9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:34 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:34 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:34 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 1 in 0.876s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Downloaded image fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume d34a8f89-e3a6-417d-8731-838d1202615a successfully. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 for user 7b333d0926e44605b630d954493780b6 is deleted. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Marking volume d34a8f89-e3a6-417d-8731-838d1202615a as bootable. {{(pid=81902) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Copying metadata from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 to d34a8f89-e3a6-417d-8731-838d1202615a. {{(pid=81902) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Creating volume glance metadata for volume d34a8f89-e3a6-417d-8731-838d1202615a backed by image fbaaf1b8-b24b-4256-a358-443af08ba5c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81902) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f36f1d8-9601-4a16-bb56-24ac31beacbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34a8f89-e3a6-417d-8731-838d1202615a', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500ba2f0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf2eb7c-8176-4193-8377-8b99626e4eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:34 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Volume volume-d34a8f89-e3a6-417d-8731-838d1202615a (d34a8f89-e3a6-417d-8731-838d1202615a): created successfully
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf2eb7c-8176-4193-8377-8b99626e4eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Flow 'volume_create_manager' (b8c55d58-6645-4972-b1f6-3e5fcf73eb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f9882841-7e94-44c6-a62f-b4921b7eae6f tempest-VolumesExtendTest-1443658418 None] Created volume successfully.
Apr 24 01:13:35 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.939s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:35 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea
Apr 24 01:13:35 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[05515636-5473-4fe2-af71-836958d12d56]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:35 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:35 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:35 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea" returned: 0 in 0.943s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:35 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea
Apr 24 01:13:35 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:36 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 0.749s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (bc48a0d7-5f92-4627-ad8f-747cc461cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08dc8fb-b8e4-4ffe-9b20-8bb61d92cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08dc8fb-b8e4-4ffe-9b20-8bb61d92cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1585904974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aca6759-8e1a-4452-987a-83837cfddbc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:36Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a150a5f-72bf-4588-b1c8-8eacfb15cb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a150a5f-72bf-4588-b1c8-8eacfb15cb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0eccd4-8f82-4d34-a78c-5085f2aa8384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0eccd4-8f82-4d34-a78c-5085f2aa8384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aca6759-8e1a-4452-987a-83837cfddbc4', 'volume_name': 'volume-7aca6759-8e1a-4452-987a-83837cfddbc4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee67ea-f6f8-4a8e-9c11-1ea3c3ddc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee67ea-f6f8-4a8e-9c11-1ea3c3ddc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa477b7-089f-466c-a028-0a89fcd2dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:36 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Volume 7aca6759-8e1a-4452-987a-83837cfddbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aca6759-8e1a-4452-987a-83837cfddbc4', 'volume_size': 1}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:36 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:36 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:36 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.9ada7241-d28f-460c-bc56-600cf0d709ea" returned: 0 in 0.668s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-9ada7241-d28f-460c-bc56-600cf0d709ea" released by "_delete_snapshot" :: held 3.665s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_snapshot" :: held 3.717s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Created reservations ['986add78-c87a-48e9-8a94-1038b0f0a9c8', '985ab77a-1a66-47e3-8a77-b6a9434c8a47', 'e703848e-98c4-4ec9-b318-8b73a1eaae31', 'f9b04d7c-4daa-4603-b5d2-aaa7c6823692'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-28b08045-dd27-4cda-819e-7c82fffabe3b tempest-GroupsV320Test-1559890756 None] Group tempest-GroupsV320Test-Group-377724325: creating
Apr 24 01:13:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-28b08045-dd27-4cda-819e-7c82fffabe3b tempest-GroupsV320Test-1559890756 None] Group tempest-GroupsV320Test-Group-377724325: created successfully
Apr 24 01:13:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Delete snapshot completed successfully.
Apr 24 01:13:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-28b08045-dd27-4cda-819e-7c82fffabe3b tempest-GroupsV320Test-1559890756 None] Create group completed successfully.
Apr 24 01:13:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-baf7f585-7f90-4a4b-b4bd-fdc36ae4ab7a tempest-SnapshotsActionsTest-53748749 None] Lock "cinder-9ada7241-d28f-460c-bc56-600cf0d709ea-delete_snapshot" released by "delete_snapshot" :: held 3.976s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:37 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 1 in 0.753s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 2G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a 2G" returned: 0 in 0.078s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.635s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1585904974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aca6759-8e1a-4452-987a-83837cfddbc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:36Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Creating volume 7aca6759-8e1a-4452-987a-83837cfddbc4 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:37 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:37 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 1073741824
Apr 24 01:13:37 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:37 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5980da24-ee0f-4122-8d44-02ac6246e97b tempest-VolumesExtendTest-1443658418 None] Extend volume completed successfully.
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "cinder-8632bd6e-3a86-4553-98dd-7f719f58ff91-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-8632bd6e-3a86-4553-98dd-7f719f58ff91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "cinder-quobyte-8632bd6e-3a86-4553-98dd-7f719f58ff91" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-8632bd6e-3a86-4553-98dd-7f719f58ff91" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Deleting offline snapshot 8632bd6e-3a86-4553-98dd-7f719f58ff91 of volume cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] snapshot_file for this snap is: volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62b2cb-f908-4f30-878d-d05bef1b02b1]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:38 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:38 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-d34a8f89-e3a6-417d-8731-838d1202615a-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:38 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-d34a8f89-e3a6-417d-8731-838d1202615a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 1073741824" returned: 0 in 0.956s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-quobyte-d34a8f89-e3a6-417d-8731-838d1202615a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:38 devstack sudo[87761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4
Apr 24 01:13:38 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-d34a8f89-e3a6-417d-8731-838d1202615a" acquired by "delete_volume" :: waited 0.044s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe20ff-66b0-4383-9f8b-f4449dea644e]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:38 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:38 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Created reservations ['fb9352c4-cecd-420e-96e9-927752e9103b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:38 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.852s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdb9282-623e-4909-928e-49c21cc80d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:38 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:38 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e540ae-cb9a-410f-9050-0355656fb8fc]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:38 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10
Apr 24 01:13:38 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:39 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4" returned: 0 in 0.779s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa477b7-089f-466c-a028-0a89fcd2dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aca6759-8e1a-4452-987a-83837cfddbc4', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0eeec-c436-4fc2-a1a4-9f471f7d5941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:39 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Volume volume-7aca6759-8e1a-4452-987a-83837cfddbc4 (7aca6759-8e1a-4452-987a-83837cfddbc4): created successfully
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0eeec-c436-4fc2-a1a4-9f471f7d5941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (bc48a0d7-5f92-4627-ad8f-747cc461cee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e658aceb-b924-45a9-a8fe-a8672ce42205 tempest-VolumesListTestJSON-1856964063 None] Created volume successfully.
Apr 24 01:13:39 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 0.844s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:39 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:39 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:39 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.615s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-58ea1a04-afbf-4722-bd75-fdad97ef7a09 tempest-GroupsV320Test-1559890756 None] Delete group completed successfully.
Apr 24 01:13:39 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10" returned: 0 in 0.661s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:39 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:39 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:39 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 1 in 0.666s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:13:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:39 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a
Apr 24 01:13:39 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (e82dcafe-fedb-4539-9be7-4417fc2dd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e35abff-24f7-48c0-85a0-4530aeb1d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e35abff-24f7-48c0-85a0-4530aeb1d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971164259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2405e19c-dabe-4a6f-bd20-68851fdf4c56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:40Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e3911c-ea61-42e4-87cc-02700273d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e3911c-ea61-42e4-87cc-02700273d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50425fac-5f48-46c3-a35c-610d21c41885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50425fac-5f48-46c3-a35c-610d21c41885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2405e19c-dabe-4a6f-bd20-68851fdf4c56', 'volume_name': 'volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39473da-97e0-4d4e-91e0-ce521b85d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39473da-97e0-4d4e-91e0-ce521b85d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af15e14-f11b-42f1-80c3-2ddbc0eced8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Volume 2405e19c-dabe-4a6f-bd20-68851fdf4c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56', 'volume_size': 1}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971164259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2405e19c-dabe-4a6f-bd20-68851fdf4c56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:40Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Creating volume 2405e19c-dabe-4a6f-bd20-68851fdf4c56 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:40 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:40 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.836s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:40 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 1073741824
Apr 24 01:13:40 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:40 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91
Apr 24 01:13:40 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:40 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d34a8f89-e3a6-417d-8731-838d1202615a" returned: 0 in 0.925s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-d34a8f89-e3a6-417d-8731-838d1202615a" released by "delete_volume" :: held 2.515s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:40 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10.8632bd6e-3a86-4553-98dd-7f719f58ff91" returned: 0 in 0.530s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-8632bd6e-3a86-4553-98dd-7f719f58ff91" released by "_delete_snapshot" :: held 3.020s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_snapshot" :: held 3.057s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:40 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Created reservations ['a75eb203-2254-4eb9-b569-e12d944388b3', '42500585-3228-4cfc-bdae-ef3e944e5556', '4c764606-2126-44ae-bee2-25c3c4546fcd', 'e13ab21e-eeed-4a8b-b9d8-126109a08b65'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Created reservations ['cdea587c-8213-46c1-8c1d-7c63ead84026', '8c9c0383-49b3-4d8b-948c-d4c20a52a454', 'e9c6669c-235d-468f-bca3-238afb47ee88', '94d00717-3be5-41fd-9a90-dc1d61bba464'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:41 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:41 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Delete snapshot completed successfully.
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c8f194-6edf-47be-a15f-b88e9adac49d tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-8632bd6e-3a86-4553-98dd-7f719f58ff91-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:41 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 1073741824" returned: 0 in 0.923s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:41 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56
Apr 24 01:13:41 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:41 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.648s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Deleted volume successfully.
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f7a580f6-96d5-4bcd-bc51-24c9acb66615 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-d34a8f89-e3a6-417d-8731-838d1202615a-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:41 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56" returned: 0 in 0.699s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af15e14-f11b-42f1-80c3-2ddbc0eced8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f5d628-9a4e-4862-9194-c1d989e5925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Volume volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 (2405e19c-dabe-4a6f-bd20-68851fdf4c56): created successfully
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f5d628-9a4e-4862-9194-c1d989e5925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (e82dcafe-fedb-4539-9be7-4417fc2dd880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Flow 'volume_create_manager' (199e14e4-e5fb-4bda-9466-2b5d3427196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d562d5-1934-4b3a-8335-59374c8a28b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-739fd2fc-6c3d-40f6-86e8-4e3532777932 tempest-VolumesListTestJSON-1856964063 None] Created volume successfully.
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "cinder-cfdb9282-623e-4909-928e-49c21cc80d10-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d562d5-1934-4b3a-8335-59374c8a28b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1562063106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fda326-833c-4a3a-bf1e-d22d277a3bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8d0f9045e4236b95256259d22e6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:42Z,use_quota=True,user_id='7b333d0926e44605b630d954493780b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506e6968-4eda-427b-8d16-dda89d7cac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506e6968-4eda-427b-8d16-dda89d7cac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2dd0639-c361-4246-9d95-c83002bbd823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2dd0639-c361-4246-9d95-c83002bbd823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56fda326-833c-4a3a-bf1e-d22d277a3bff', 'volume_name': 'volume-56fda326-833c-4a3a-bf1e-d22d277a3bff', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4693e1-f333-4e3f-a04c-bdac1d40a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4693e1-f333-4e3f-a04c-bdac1d40a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8436e0-c0ac-46d8-84df-af5186e8dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Volume 56fda326-833c-4a3a-bf1e-d22d277a3bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56fda326-833c-4a3a-bf1e-d22d277a3bff', 'volume_size': 1}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1562063106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fda326-833c-4a3a-bf1e-d22d277a3bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8d0f9045e4236b95256259d22e6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:42Z,use_quota=True,user_id='7b333d0926e44605b630d954493780b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Creating volume 56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:42 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-cfdb9282-623e-4909-928e-49c21cc80d10-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:42 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff 1073741824
Apr 24 01:13:42 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0afe29-544d-40ff-a7f3-799521f0e173]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:42 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10
Apr 24 01:13:42 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (175fe11c-2fd3-4957-98a6-d91b50cfbf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88446d7e-4e8a-4864-964b-0cf6e615a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88446d7e-4e8a-4864-964b-0cf6e615a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1485633257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f431cacb-9e87-4c04-92f2-99b5e7ca8326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:43Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753a6ec3-e8cb-465a-9eb0-58d7af2410c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753a6ec3-e8cb-465a-9eb0-58d7af2410c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b803e8-04bf-4398-8589-9bc460e34244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b803e8-04bf-4398-8589-9bc460e34244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f431cacb-9e87-4c04-92f2-99b5e7ca8326', 'volume_name': 'volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ebcb6-fb37-45be-a698-5da5ac389216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ebcb6-fb37-45be-a698-5da5ac389216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612916f2-ca41-41ca-a9f0-d5c495326742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Volume f431cacb-9e87-4c04-92f2-99b5e7ca8326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326', 'volume_size': 1}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:43 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff 1073741824" returned: 0 in 1.022s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:43 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10" returned: 0 in 0.922s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:43 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:43 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:43 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10
Apr 24 01:13:43 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:43 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 0.602s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1485633257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f431cacb-9e87-4c04-92f2-99b5e7ca8326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89f7072fa0b24f16bec61cdf1f723701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:43Z,use_quota=True,user_id='ae915978ca01418ba16096ec34bb4400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Creating volume f431cacb-9e87-4c04-92f2-99b5e7ca8326 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:43 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:43 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8436e0-c0ac-46d8-84df-af5186e8dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56fda326-833c-4a3a-bf1e-d22d277a3bff', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108d2599-4f80-4f52-ba1b-07b8be7b087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:43 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 1073741824
Apr 24 01:13:43 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cfdb9282-623e-4909-928e-49c21cc80d10" returned: 0 in 0.678s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Volume volume-56fda326-833c-4a3a-bf1e-d22d277a3bff (56fda326-833c-4a3a-bf1e-d22d277a3bff): created successfully
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108d2599-4f80-4f52-ba1b-07b8be7b087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Flow 'volume_create_manager' (199e14e4-e5fb-4bda-9466-2b5d3427196d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-quobyte-cfdb9282-623e-4909-928e-49c21cc80d10" released by "delete_volume" :: held 1.733s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1717141b-0a92-4ffc-92b1-5910f70dd47c tempest-VolumesExtendTest-1443658418 None] Created volume successfully.
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Created reservations ['1888a948-37ee-4f01-b707-d62da06d7a8d', 'a6b35365-4b48-4265-9346-4a3c0c6c3df5', '6e558fec-f256-4946-be70-caba6a543c0e', 'b56d73bc-1468-419b-887f-9f898d5648b8'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:44 devstack sudo[87827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:44 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:44 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 1073741824" returned: 0 in 0.962s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:44 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326
Apr 24 01:13:44 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:45 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.714s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:45 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Deleted volume successfully.
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-8751de1e-1075-43b3-adf8-b9dd9977c63f tempest-SnapshotsActionsTest-1127389227 None] Lock "cinder-cfdb9282-623e-4909-928e-49c21cc80d10-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:45 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326" returned: 0 in 0.657s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.054s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612916f2-ca41-41ca-a9f0-d5c495326742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f603e89-10a3-4592-b1c1-369c8ddb0900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Creating offline snapshot 31931ea7-81d3-432b-8409-b046bd6bcb76 of volume 56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844300a-77fc-441e-9efb-0e4ba70b6518]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Volume volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 (f431cacb-9e87-4c04-92f2-99b5e7ca8326): created successfully
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f603e89-10a3-4592-b1c1-369c8ddb0900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Flow 'volume_create_manager' (175fe11c-2fd3-4957-98a6-d91b50cfbf11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:45 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-602227ce-35b6-4412-9b7e-3c89d5871d3d tempest-VolumesListTestJSON-1856964063 None] Created volume successfully.
Apr 24 01:13:45 devstack sudo[87836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:45 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:46 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 0.745s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:46 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 1G
Apr 24 01:13:46 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:47 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 1G" returned: 0 in 0.883s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56fda326-833c-4a3a-bf1e-d22d277a3bff -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:47 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56fda326-833c-4a3a-bf1e-d22d277a3bff -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76
Apr 24 01:13:47 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:47 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56fda326-833c-4a3a-bf1e-d22d277a3bff -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76" returned: 0 in 0.619s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:47 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 is being set with open permissions: ugo+rw
Apr 24 01:13:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:47 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76
Apr 24 01:13:47 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:48 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76" returned: 0 in 0.688s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:48 devstack sudo[87856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info
Apr 24 01:13:48 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-f431cacb-9e87-4c04-92f2-99b5e7ca8326-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-f431cacb-9e87-4c04-92f2-99b5e7ca8326-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-quobyte-f431cacb-9e87-4c04-92f2-99b5e7ca8326" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:49 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-f431cacb-9e87-4c04-92f2-99b5e7ca8326" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info" returned: 0 in 0.812s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:49 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info is being set with open permissions: ugo+rw
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49c7d63-eee1-4c11-8155-b9de4e7f7aa9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:49 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info
Apr 24 01:13:49 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:49 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326
Apr 24 01:13:49 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:49 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.info" returned: 0 in 0.572s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:50 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-331fccf3-dd1c-4892-b53b-84dce68f7f0f tempest-VolumesExtendTest-1443658418 None] Create snapshot completed successfully
Apr 24 01:13:50 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326" returned: 0 in 0.795s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:50 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326
Apr 24 01:13:50 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:50 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f431cacb-9e87-4c04-92f2-99b5e7ca8326" returned: 0 in 0.546s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-f431cacb-9e87-4c04-92f2-99b5e7ca8326" released by "delete_volume" :: held 1.403s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Created reservations ['1112426e-a975-4f3b-8ac2-10f1e7a2b2d4', '82314e5c-107c-402d-ba1e-eaa51dcd6ddb', '12cb8ceb-376b-4928-b7be-11b8a0e64c72', '4ee58fd9-b84e-45fe-ae0d-cdf6871e090f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:51 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:51 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf56c12a-2191-4ab5-927f-9e47220bf356]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:51 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:51 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:51 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.674s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Deleted volume successfully.
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1b81c3ab-7d7f-4f46-8e65-6aa4c76831dc tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-f431cacb-9e87-4c04-92f2-99b5e7ca8326-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-2405e19c-dabe-4a6f-bd20-68851fdf4c56-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-2405e19c-dabe-4a6f-bd20-68851fdf4c56-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:51 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 0.915s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 2G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-quobyte-2405e19c-dabe-4a6f-bd20-68851fdf4c56" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-2405e19c-dabe-4a6f-bd20-68851fdf4c56" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec86731-e638-401a-b51c-3b5b213a115d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 2G" returned: 0 in 0.175s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.134s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:52 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56
Apr 24 01:13:52 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e81febdd-1d60-4c9d-9465-017f34ca005b tempest-VolumesExtendTest-1443658418 None] Extend volume completed successfully.
Apr 24 01:13:52 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56" returned: 0 in 0.753s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:52 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56
Apr 24 01:13:52 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-31931ea7-81d3-432b-8409-b046bd6bcb76-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-31931ea7-81d3-432b-8409-b046bd6bcb76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-quobyte-31931ea7-81d3-432b-8409-b046bd6bcb76" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-31931ea7-81d3-432b-8409-b046bd6bcb76" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:53 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Deleting offline snapshot 31931ea7-81d3-432b-8409-b046bd6bcb76 of volume 56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] snapshot_file for this snap is: volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-2405e19c-dabe-4a6f-bd20-68851fdf4c56" returned: 0 in 0.719s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-2405e19c-dabe-4a6f-bd20-68851fdf4c56" released by "delete_volume" :: held 1.521s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68b6be-5723-437c-863c-9cd92c09ee6a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Created reservations ['1c487905-fc2b-4896-8bfa-a5a461cd789d', '274095f9-f538-4776-90a0-8b42030cd788', '39f5986d-d61a-4076-98b9-493a94eefb3d', 'ca32bc6b-38ad-41cf-82a4-24c18e8fd99a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:53 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76
Apr 24 01:13:53 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:53 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:53 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-7aca6759-8e1a-4452-987a-83837cfddbc4-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-7aca6759-8e1a-4452-987a-83837cfddbc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "cinder-quobyte-7aca6759-8e1a-4452-987a-83837cfddbc4" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-7aca6759-8e1a-4452-987a-83837cfddbc4" acquired by "delete_volume" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[53871cae-81ad-4293-9439-8e5c1cda2d08]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:54 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4
Apr 24 01:13:54 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:54 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.873s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Deleted volume successfully.
Apr 24 01:13:54 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76" returned: 0 in 1.038s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56fda326-833c-4a3a-bf1e-d22d277a3bff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974e411-85f0-4dae-9bff-c6dfacde2916]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fd2b360-4483-4cc1-ab7b-26b05cd5363d tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-2405e19c-dabe-4a6f-bd20-68851fdf4c56-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:54 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:54 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:55 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4" returned: 0 in 0.951s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:55 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4
Apr 24 01:13:55 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:55 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 0.850s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:55 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76
Apr 24 01:13:55 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Flow 'volume_create_manager' (5fadaf3c-8639-445b-9e2f-0451659be953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34c135-881e-479a-920e-643b28159504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34c135-881e-479a-920e-643b28159504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1047598218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bded8a6f-5da7-4164-8e93-fb57d3c1d79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1934642f0cc408a968fba5a0db5adfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:56Z,use_quota=True,user_id='d064ccbd2a9947069d70a7661c5bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eff8bd-76c8-47ca-bc34-e467cb160633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eff8bd-76c8-47ca-bc34-e467cb160633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5480e1ff-412b-4620-b673-baceace4205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5480e1ff-412b-4620-b673-baceace4205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bded8a6f-5da7-4164-8e93-fb57d3c1d79f', 'volume_name': 'volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae512c90-1f3b-4102-bb62-bc22c3eb8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae512c90-1f3b-4102-bb62-bc22c3eb8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894fdbe4-c95d-4b1f-b400-02285280d357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:56 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume bded8a6f-5da7-4164-8e93-fb57d3c1d79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f', 'volume_size': 1}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1047598218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bded8a6f-5da7-4164-8e93-fb57d3c1d79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1934642f0cc408a968fba5a0db5adfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:56Z,use_quota=True,user_id='d064ccbd2a9947069d70a7661c5bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Creating volume bded8a6f-5da7-4164-8e93-fb57d3c1d79f {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:56 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:13:56 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7aca6759-8e1a-4452-987a-83837cfddbc4" returned: 0 in 0.766s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-quobyte-7aca6759-8e1a-4452-987a-83837cfddbc4" released by "delete_volume" :: held 1.780s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:56 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f 1073741824
Apr 24 01:13:56 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Created reservations ['c389ea58-700d-49fa-b15a-79c6e71811a4', 'e5d1d9b0-9230-44e9-affc-20ecccf006dc', '97677105-a155-46c6-b0ef-3a7b9f9bec34', 'e42a90d9-aac9-4192-aa75-76f18d5526ea'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:56 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:13:56 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:56 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76" returned: 0 in 0.897s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:56 devstack sudo[87921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76
Apr 24 01:13:56 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:57 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f 1073741824" returned: 0 in 0.873s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:57 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f
Apr 24 01:13:57 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:57 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff.31931ea7-81d3-432b-8409-b046bd6bcb76" returned: 0 in 0.751s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-31931ea7-81d3-432b-8409-b046bd6bcb76" released by "_delete_snapshot" :: held 3.707s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" released by "delete_snapshot" :: held 3.747s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:57 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.911s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:13:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Deleted volume successfully.
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ef5d6459-5aca-459e-8752-62622f3dd5ad tempest-VolumesListTestJSON-1856964063 None] Lock "cinder-7aca6759-8e1a-4452-987a-83837cfddbc4-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Created reservations ['27a940c7-ba6a-4591-b744-e6dfbf59f60a', 'e035fc2d-b11a-4c8b-9ef9-c1b0a38f454a', '151d0e42-2a74-431b-ac2d-cb042691aef1', '49b58a70-2eb3-45a7-bad9-9b2b7e63782d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:13:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Delete snapshot completed successfully.
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2b843d28-3819-4e02-ba36-f61fc2b1b870 tempest-VolumesExtendTest-1443658418 None] Lock "cinder-31931ea7-81d3-432b-8409-b046bd6bcb76-delete_snapshot" released by "delete_snapshot" :: held 4.000s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:13:57 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" returned: 0 in 0.779s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894fdbe4-c95d-4b1f-b400-02285280d357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7955dc-be05-49a0-bf26-6774527b5eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:13:57 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f (bded8a6f-5da7-4164-8e93-fb57d3c1d79f): created successfully
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7955dc-be05-49a0-bf26-6774527b5eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:13:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Flow 'volume_create_manager' (5fadaf3c-8639-445b-9e2f-0451659be953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:13:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ea6d2925-3dcf-4772-a0d9-ee12165e06e3 tempest-VolumeQuotasAdminTestJSON-239965092 None] Created volume successfully.
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-56fda326-833c-4a3a-bf1e-d22d277a3bff-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "cinder-56fda326-833c-4a3a-bf1e-d22d277a3bff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Acquiring lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9264a9d-0961-42e6-9530-f5cf00065a7b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "cinder-bded8a6f-5da7-4164-8e93-fb57d3c1d79f-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "cinder-bded8a6f-5da7-4164-8e93-fb57d3c1d79f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:58 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:58 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "cinder-quobyte-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "cinder-quobyte-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d966c-e2aa-4e44-89b4-b7cfff2b25c2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:13:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:58 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f
Apr 24 01:13:58 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:59 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 1.028s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:59 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff
Apr 24 01:13:59 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:13:59 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Apr 24 01:13:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" returned: 0 in 1.047s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:13:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:13:59 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f
Apr 24 01:13:59 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:00 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-56fda326-833c-4a3a-bf1e-d22d277a3bff" returned: 0 in 0.706s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "cinder-quobyte-56fda326-833c-4a3a-bf1e-d22d277a3bff" released by "delete_volume" :: held 1.812s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Created reservations ['a119682b-5a3e-4a40-a54e-289a958b07ec', '5ead00af-fb96-4c12-92a2-57de25fa9618', '98ddcde5-be04-4466-ac02-9443454b9d4c', '0c290fd7-78e0-4df5-a89c-87abeb678dcb'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:00 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:00 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:00 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" returned: 0 in 0.775s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "cinder-quobyte-bded8a6f-5da7-4164-8e93-fb57d3c1d79f" released by "delete_volume" :: held 1.895s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Created reservations ['94abe9bf-031d-4102-8115-3c16590e6464', 'bc1e3e0d-464e-42e6-9a5c-5df3860986a5', '7f5fab7b-a537-460a-82db-0f45f2b55711', '67a22818-9f6f-4b8e-a605-30504b722607'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:00 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:00 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:01 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.883s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:01 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Deleted volume successfully.
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a04e930d-1919-4a0c-b775-d1722c8ee10e tempest-VolumesExtendTest-1443658418 None] Lock "cinder-56fda326-833c-4a3a-bf1e-d22d277a3bff-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Flow 'volume_create_manager' (a2582840-6d26-4348-8850-398260321d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9302e5a-db2d-4d72-801c-d3e3b9410fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9302e5a-db2d-4d72-801c-d3e3b9410fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1638749998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23781ada-3e99-4b7a-846d-f57114437e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380d26bb19594e9abdb2deacf8e0d1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:02Z,use_quota=True,user_id='b29b4c6e77634b14aac8a06a29a7b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ad2ef4-e1a8-40bf-9291-a1afb97c2165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:01 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ad2ef4-e1a8-40bf-9291-a1afb97c2165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f34a71-ba48-4fb4-ad8f-bc68e106fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f34a71-ba48-4fb4-ad8f-bc68e106fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23781ada-3e99-4b7a-846d-f57114437e65', 'volume_name': 'volume-23781ada-3e99-4b7a-846d-f57114437e65', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47af21f9-903e-47f1-8f03-a3c6dc1a56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47af21f9-903e-47f1-8f03-a3c6dc1a56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418479ab-ee7c-45ad-b7db-c25c1c69a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:01 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Volume 23781ada-3e99-4b7a-846d-f57114437e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23781ada-3e99-4b7a-846d-f57114437e65', 'volume_size': 1}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1638749998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23781ada-3e99-4b7a-846d-f57114437e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380d26bb19594e9abdb2deacf8e0d1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:02Z,use_quota=True,user_id='b29b4c6e77634b14aac8a06a29a7b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Creating volume 23781ada-3e99-4b7a-846d-f57114437e65 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:01 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.945s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:01 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Deleted volume successfully.
Apr 24 01:14:01 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 1073741824
Apr 24 01:14:01 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a643992-e7f2-4630-bb8f-7ee8fdda9fa0 tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "cinder-bded8a6f-5da7-4164-8e93-fb57d3c1d79f-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Flow 'volume_create_manager' (8ec1189d-6556-4c1f-bb6d-50aec895ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53574372-ee72-4656-bb8b-f533a10ad40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53574372-ee72-4656-bb8b-f533a10ad40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-130084563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e96193-71a7-41e7-8fe6-f34685dc5727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1934642f0cc408a968fba5a0db5adfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:02Z,use_quota=True,user_id='d064ccbd2a9947069d70a7661c5bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b30c260-27c0-49e9-90c8-20b518e1508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b30c260-27c0-49e9-90c8-20b518e1508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555abd50-e866-429e-97b3-265f0d68ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555abd50-e866-429e-97b3-265f0d68ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e96193-71a7-41e7-8fe6-f34685dc5727', 'volume_name': 'volume-58e96193-71a7-41e7-8fe6-f34685dc5727', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3537c26-2f88-48f2-bff0-446b52c6c518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3537c26-2f88-48f2-bff0-446b52c6c518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7842f72e-222d-4056-8e88-4c43383d9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:02 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume 58e96193-71a7-41e7-8fe6-f34685dc5727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e96193-71a7-41e7-8fe6-f34685dc5727', 'volume_size': 1}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:02 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 1073741824" returned: 0 in 0.969s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:02 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65
Apr 24 01:14:02 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:03 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65" returned: 0 in 0.569s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-130084563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e96193-71a7-41e7-8fe6-f34685dc5727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1934642f0cc408a968fba5a0db5adfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:02Z,use_quota=True,user_id='d064ccbd2a9947069d70a7661c5bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Creating volume 58e96193-71a7-41e7-8fe6-f34685dc5727 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:03 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418479ab-ee7c-45ad-b7db-c25c1c69a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23781ada-3e99-4b7a-846d-f57114437e65', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc23285-3769-4efc-b325-872576469f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:03 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 1073741824
Apr 24 01:14:03 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:03 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Volume volume-23781ada-3e99-4b7a-846d-f57114437e65 (23781ada-3e99-4b7a-846d-f57114437e65): created successfully
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc23285-3769-4efc-b325-872576469f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Flow 'volume_create_manager' (a2582840-6d26-4348-8850-398260321d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:03 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-575abc68-044a-4ea3-b32b-f670c742309f tempest-VolumesNegativeTest-265530867 None] Created volume successfully.
Apr 24 01:14:04 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 1073741824" returned: 0 in 0.815s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:04 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727
Apr 24 01:14:04 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (6f67ac25-0404-426c-bbfc-1c9d151546e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7bc753-8c2d-4fb0-abae-24c5f36ff309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7bc753-8c2d-4fb0-abae-24c5f36ff309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923291972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a214d39b-c7c1-4cfd-9709-f10d15a9a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:05Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ce89be-92d7-4290-83ce-50cc4eb074dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ce89be-92d7-4290-83ce-50cc4eb074dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064cbd51-0e8e-47c5-9a3f-a27d4906c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064cbd51-0e8e-47c5-9a3f-a27d4906c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a214d39b-c7c1-4cfd-9709-f10d15a9a14d', 'volume_name': 'volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a066d7bf-4bac-49f2-9aab-4b1663414106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a066d7bf-4bac-49f2-9aab-4b1663414106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc2dea7-9031-48c9-9adc-7f87daab6c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume a214d39b-c7c1-4cfd-9709-f10d15a9a14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d', 'volume_size': 1}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:04 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727" returned: 0 in 0.619s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923291972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a214d39b-c7c1-4cfd-9709-f10d15a9a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:05Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume a214d39b-c7c1-4cfd-9709-f10d15a9a14d {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:04 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7842f72e-222d-4056-8e88-4c43383d9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e96193-71a7-41e7-8fe6-f34685dc5727', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d 1073741824
Apr 24 01:14:04 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8d210e-53a7-4351-9ff3-4cc55be8aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Volume volume-58e96193-71a7-41e7-8fe6-f34685dc5727 (58e96193-71a7-41e7-8fe6-f34685dc5727): created successfully
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8d210e-53a7-4351-9ff3-4cc55be8aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Flow 'volume_create_manager' (8ec1189d-6556-4c1f-bb6d-50aec895ad03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a1b989d0-9370-4bf5-bd4a-bf89e2dcb96d tempest-VolumeQuotasAdminTestJSON-239965092 None] Created volume successfully.
Apr 24 01:14:05 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d 1073741824" returned: 0 in 1.000s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:05 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d
Apr 24 01:14:05 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:06 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" returned: 0 in 0.707s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc2dea7-9031-48c9-9adc-7f87daab6c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f2405-fa54-433e-a618-b59539fee037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:06 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ab1e053b-c79c-40f2-bafa-b12b9676c6d9 tempest-VolumeQuotasAdminTestJSON-1436792409 None] Transfer volume completed successfully.
Apr 24 01:14:06 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d (a214d39b-c7c1-4cfd-9709-f10d15a9a14d): created successfully
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f2405-fa54-433e-a618-b59539fee037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (6f67ac25-0404-426c-bbfc-1c9d151546e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:06 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d17b4df8-3a46-4f2e-a5c4-fd24d426ab65 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (41dfdad7-1216-41ef-a5fe-10bf992d7b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0616ac81-8532-44c3-bc4b-4d3afbad086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0616ac81-8532-44c3-bc4b-4d3afbad086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731465929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084f99eb-9ad1-48b0-a29e-c24815771d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:07Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2a9b5b-62ae-486f-ac57-af94561589f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2a9b5b-62ae-486f-ac57-af94561589f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5791432a-3409-435a-8437-f18c5c429ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5791432a-3409-435a-8437-f18c5c429ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084f99eb-9ad1-48b0-a29e-c24815771d0b', 'volume_name': 'volume-084f99eb-9ad1-48b0-a29e-c24815771d0b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e336b59-56df-43f1-8511-3ae41b74df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e336b59-56df-43f1-8511-3ae41b74df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29a6ef5-d6e6-4c0d-8774-1746b600fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume 084f99eb-9ad1-48b0-a29e-c24815771d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084f99eb-9ad1-48b0-a29e-c24815771d0b', 'volume_size': 1}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731465929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084f99eb-9ad1-48b0-a29e-c24815771d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:07Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume 084f99eb-9ad1-48b0-a29e-c24815771d0b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:07 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:07 devstack sudo[87985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b 1073741824
Apr 24 01:14:07 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (72d1934d-f2df-4cc1-80a0-cf599341d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3ef89-19ef-4070-814d-91c1baee6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3ef89-19ef-4070-814d-91c1baee6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633500340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8da908-abab-49be-ad16-808372677b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:08Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356aace1-a4c3-4cd2-9eab-f560887f8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356aace1-a4c3-4cd2-9eab-f560887f8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c66427-6407-4bc2-907d-edf149729477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c66427-6407-4bc2-907d-edf149729477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8da908-abab-49be-ad16-808372677b6b', 'volume_name': 'volume-3d8da908-abab-49be-ad16-808372677b6b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ff583-611d-4323-b473-93348f61a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ff583-611d-4323-b473-93348f61a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ec21f1-4f83-49b2-b81a-ef8374ed14fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume 3d8da908-abab-49be-ad16-808372677b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8da908-abab-49be-ad16-808372677b6b', 'volume_size': 1}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Acquiring lock "cinder-58e96193-71a7-41e7-8fe6-f34685dc5727-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "cinder-58e96193-71a7-41e7-8fe6-f34685dc5727-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Acquiring lock "cinder-quobyte-58e96193-71a7-41e7-8fe6-f34685dc5727" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "cinder-quobyte-58e96193-71a7-41e7-8fe6-f34685dc5727" acquired by "delete_volume" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6d799-5ffa-4396-8ddd-90bee069e69d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:08 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727
Apr 24 01:14:08 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (df44fb10-dfa2-4e75-99d7-4d340edb3b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2158cf1a-4736-4899-ba0e-41a04240cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2158cf1a-4736-4899-ba0e-41a04240cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146706201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bef133-ea1e-4093-b64b-13fe053467b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:08Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87212ad-905b-49cc-ade7-e3335acca1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87212ad-905b-49cc-ade7-e3335acca1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb5d90-22a2-4fff-9721-3843b515c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb5d90-22a2-4fff-9721-3843b515c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bef133-ea1e-4093-b64b-13fe053467b9', 'volume_name': 'volume-b8bef133-ea1e-4093-b64b-13fe053467b9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc3c40-2d1c-42e7-b73b-ee095f3bad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc3c40-2d1c-42e7-b73b-ee095f3bad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7498d-41c6-41b2-bc79-d292b9bc40bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume b8bef133-ea1e-4093-b64b-13fe053467b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bef133-ea1e-4093-b64b-13fe053467b9', 'volume_size': 1}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:08 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b 1073741824" returned: 0 in 1.122s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:08 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b
Apr 24 01:14:08 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (157f6145-d590-47bc-ae25-a3228d183a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f89f108-7570-4e67-a5ab-68dc98bfd3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f89f108-7570-4e67-a5ab-68dc98bfd3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472650486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5450d59b-faf5-43a1-ae2a-c93e41e88bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:09Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fa1a40-8cca-4bb4-952d-80d012297bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fa1a40-8cca-4bb4-952d-80d012297bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b19c79-ad2d-4884-b289-45bb20da743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b19c79-ad2d-4884-b289-45bb20da743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5450d59b-faf5-43a1-ae2a-c93e41e88bab', 'volume_name': 'volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06518198-705a-42ce-bf41-f175ab3e7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06518198-705a-42ce-bf41-f175ab3e7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e967f45-6739-459f-8015-8de171bc0dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume 5450d59b-faf5-43a1-ae2a-c93e41e88bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab', 'volume_size': 1}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (a8e7db8e-d1e5-4c6e-834a-47d0be4c905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2f842-0d7d-4296-b2b0-7417dca471ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2f842-0d7d-4296-b2b0-7417dca471ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941017067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6394005-119e-4f10-912b-cdbad505a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:09Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7f1ed-6c1e-429e-ad35-5054ff9ba2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7f1ed-6c1e-429e-ad35-5054ff9ba2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e708c0b-958f-4424-b3ee-97c1cad5ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e708c0b-958f-4424-b3ee-97c1cad5ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6394005-119e-4f10-912b-cdbad505a7e6', 'volume_name': 'volume-d6394005-119e-4f10-912b-cdbad505a7e6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a3de3e-903e-41f9-bada-224b7ac6ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a3de3e-903e-41f9-bada-224b7ac6ede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06804f4c-e64d-4574-8a40-e82ea18af419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume d6394005-119e-4f10-912b-cdbad505a7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6394005-119e-4f10-912b-cdbad505a7e6', 'volume_size': 1}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:09 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727" returned: 0 in 1.071s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:09 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727
Apr 24 01:14:09 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:09 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b" returned: 0 in 0.816s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633500340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8da908-abab-49be-ad16-808372677b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:08Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume 3d8da908-abab-49be-ad16-808372677b6b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:09 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29a6ef5-d6e6-4c0d-8774-1746b600fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084f99eb-9ad1-48b0-a29e-c24815771d0b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b 1073741824
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e2e15-21b1-4cf9-9940-74ed67d64b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:09 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:09 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-084f99eb-9ad1-48b0-a29e-c24815771d0b (084f99eb-9ad1-48b0-a29e-c24815771d0b): created successfully
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e2e15-21b1-4cf9-9940-74ed67d64b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (41dfdad7-1216-41ef-a5fe-10bf992d7b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:09 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f8f3e5eb-7fbe-444f-a410-222bded7f574 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:09 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-58e96193-71a7-41e7-8fe6-f34685dc5727" returned: 0 in 0.628s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "cinder-quobyte-58e96193-71a7-41e7-8fe6-f34685dc5727" released by "delete_volume" :: held 1.768s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Created reservations ['720e3ce1-db5f-43d8-81a2-b0ec5591afbc', 'be7a5592-21b5-4cf7-96f9-78425ce1f437', 'ef9f4b2c-2548-439f-a35a-dcb12854692c', '49312658-3232-47c7-915b-7f8317a32ac8'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:10 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:10 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:10 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b 1073741824" returned: 0 in 1.239s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:10 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b
Apr 24 01:14:10 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:11 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.000s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:11 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Deleted volume successfully.
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-14271199-9a6a-4e29-bd91-6b4d8bab49a0 tempest-VolumeQuotasAdminTestJSON-1650809128 None] Lock "cinder-58e96193-71a7-41e7-8fe6-f34685dc5727-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:11 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b" returned: 0 in 1.058s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.299s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146706201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bef133-ea1e-4093-b64b-13fe053467b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:08Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume b8bef133-ea1e-4093-b64b-13fe053467b9 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:11 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=152,cinder:INSERT=58,cinder:UPDATE=186,cinder:DELETE=12 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:14:11 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 1073741824
Apr 24 01:14:11 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ec21f1-4f83-49b2-b81a-ef8374ed14fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8da908-abab-49be-ad16-808372677b6b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faa03c7-a307-4117-8a88-6cc82f4d4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:11 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=176,cinder:UPDATE=210,cinder:DELETE=17,cinder:INSERT=49 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:14:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-3d8da908-abab-49be-ad16-808372677b6b (3d8da908-abab-49be-ad16-808372677b6b): created successfully
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faa03c7-a307-4117-8a88-6cc82f4d4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (72d1934d-f2df-4cc1-80a0-cf599341d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Flow 'volume_create_manager' (67f4e39e-030f-4cd5-af79-84736bab1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c3a00f-a3f5-472b-a837-027fe26472dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-653306a1-8a1c-4108-af44-e649dce80d0e tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c3a00f-a3f5-472b-a837-027fe26472dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2048085455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dab488-7887-4ed8-af3e-d46d5416ca20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fed8b3190347c08254aa46ce217961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:12Z,use_quota=True,user_id='72c025cb7c7148da874b62f9c85659e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd10f192-647b-499d-b60b-d48cc94bbba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd10f192-647b-499d-b60b-d48cc94bbba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4e2191-c7c3-40f1-b089-ede76b8f2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4e2191-c7c3-40f1-b089-ede76b8f2902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dab488-7887-4ed8-af3e-d46d5416ca20', 'volume_name': 'volume-63dab488-7887-4ed8-af3e-d46d5416ca20', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72fe77a-9f9f-44e8-bb17-9caf74a32da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72fe77a-9f9f-44e8-bb17-9caf74a32da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f40880-8fd6-4e68-9a11-3a3802174e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Volume 63dab488-7887-4ed8-af3e-d46d5416ca20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dab488-7887-4ed8-af3e-d46d5416ca20', 'volume_size': 1}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:12 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 1073741824" returned: 0 in 1.001s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:12 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9
Apr 24 01:14:12 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:13 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.466s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472650486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5450d59b-faf5-43a1-ae2a-c93e41e88bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:09Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume 5450d59b-faf5-43a1-ae2a-c93e41e88bab {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7498d-41c6-41b2-bc79-d292b9bc40bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bef133-ea1e-4093-b64b-13fe053467b9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:13 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab 1073741824
Apr 24 01:14:13 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37774bb1-0c1c-4083-b3b2-96675bc8db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-b8bef133-ea1e-4093-b64b-13fe053467b9 (b8bef133-ea1e-4093-b64b-13fe053467b9): created successfully
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37774bb1-0c1c-4083-b3b2-96675bc8db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (df44fb10-dfa2-4e75-99d7-4d340edb3b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-20d43f9e-327f-4200-b3e2-9208d3622e78 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:14 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab 1073741824" returned: 0 in 0.869s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:14 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab
Apr 24 01:14:14 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:15 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab" returned: 0 in 0.589s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.800s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941017067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6394005-119e-4f10-912b-cdbad505a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ae1fb4341e4fe589141fde5f9114ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:09Z,use_quota=True,user_id='69b5aac023734159ab84edc3918c9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Creating volume d6394005-119e-4f10-912b-cdbad505a7e6 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:15 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:15 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 1073741824
Apr 24 01:14:15 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e967f45-6739-459f-8015-8de171bc0dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff2f9f2-233a-41c9-9a74-49548bb5bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab (5450d59b-faf5-43a1-ae2a-c93e41e88bab): created successfully
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff2f9f2-233a-41c9-9a74-49548bb5bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (157f6145-d590-47bc-ae25-a3228d183a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-230e4b74-e4d0-4dc2-8563-2e89f5fc291a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:15 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 1073741824" returned: 0 in 0.909s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:16 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6
Apr 24 01:14:16 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:16 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6" returned: 0 in 0.646s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.511s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2048085455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dab488-7887-4ed8-af3e-d46d5416ca20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fed8b3190347c08254aa46ce217961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:12Z,use_quota=True,user_id='72c025cb7c7148da874b62f9c85659e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Creating volume 63dab488-7887-4ed8-af3e-d46d5416ca20 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:16 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06804f4c-e64d-4574-8a40-e82ea18af419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6394005-119e-4f10-912b-cdbad505a7e6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:16 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 1073741824
Apr 24 01:14:16 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae65319-93c5-4aa5-b715-a768f78c6c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:16 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Volume volume-d6394005-119e-4f10-912b-cdbad505a7e6 (d6394005-119e-4f10-912b-cdbad505a7e6): created successfully
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae65319-93c5-4aa5-b715-a768f78c6c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Flow 'volume_create_manager' (a8e7db8e-d1e5-4c6e-834a-47d0be4c905d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-94a4e4f5-f322-4d63-819b-91c547dc7cca tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created volume successfully.
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-d6394005-119e-4f10-912b-cdbad505a7e6-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-d6394005-119e-4f10-912b-cdbad505a7e6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-d6394005-119e-4f10-912b-cdbad505a7e6" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-d6394005-119e-4f10-912b-cdbad505a7e6" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671199e-a93b-4c9a-b7c7-bcf1bac650d7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:17 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6
Apr 24 01:14:17 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:17 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 1073741824" returned: 0 in 1.023s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:17 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20
Apr 24 01:14:17 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:18 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6" returned: 0 in 0.706s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:18 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6
Apr 24 01:14:18 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:18 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20" returned: 0 in 0.582s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f40880-8fd6-4e68-9a11-3a3802174e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dab488-7887-4ed8-af3e-d46d5416ca20', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c7bd82-7fbe-4a4d-81d1-f6ca719fef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:18 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Volume volume-63dab488-7887-4ed8-af3e-d46d5416ca20 (63dab488-7887-4ed8-af3e-d46d5416ca20): created successfully
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c7bd82-7fbe-4a4d-81d1-f6ca719fef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Flow 'volume_create_manager' (67f4e39e-030f-4cd5-af79-84736bab1995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-67e29f1f-7e04-45b9-b26a-3ab94f9c227c tempest-VolumesServicesTestJSON-1235195270 None] Created volume successfully.
Apr 24 01:14:18 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6394005-119e-4f10-912b-cdbad505a7e6" returned: 0 in 0.687s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-d6394005-119e-4f10-912b-cdbad505a7e6" released by "delete_volume" :: held 1.467s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['fd6f2a3f-46ef-4305-9928-368c3fc3fd9c', '53045261-ccca-4072-b3ec-b11cdc941cbb', '50c8fcc8-7b7b-4ea5-bb01-2c4a91f754af', '44b88fa9-9616-4843-83fd-25b9e3b08eb5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:18 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:18 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Flow 'volume_create_manager' (e5f7fdb6-cbc7-44bb-bc33-97031281e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e400f822-5934-4d28-9101-1cc45256abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e400f822-5934-4d28-9101-1cc45256abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-99706369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c62b9c3-6489-4b41-a5a5-3a4904f33bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e253df659473e9e4db42ceaef4ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:19Z,use_quota=True,user_id='12998c945fd8464d8add0d6b3d5469b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f08937e-9565-469f-955c-a15dd4c89475),volume_type_id=5f08937e-9565-469f-955c-a15dd4c89475)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cecaa-5449-40ed-95bb-7c52e9d126d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cecaa-5449-40ed-95bb-7c52e9d126d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5da8d5-e745-4020-b911-fcb5b6199f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5da8d5-e745-4020-b911-fcb5b6199f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c62b9c3-6489-4b41-a5a5-3a4904f33bd9', 'volume_name': 'volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8642ee9d-904d-4ed7-bd3c-3671eb6758ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8642ee9d-904d-4ed7-bd3c-3671eb6758ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0bec46-3255-4ccc-adb2-aa236a84bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:19 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Volume 1c62b9c3-6489-4b41-a5a5-3a4904f33bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9', 'volume_size': 1}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-99706369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c62b9c3-6489-4b41-a5a5-3a4904f33bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e253df659473e9e4db42ceaef4ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:19Z,use_quota=True,user_id='12998c945fd8464d8add0d6b3d5469b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f08937e-9565-469f-955c-a15dd4c89475),volume_type_id=5f08937e-9565-469f-955c-a15dd4c89475)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Creating volume 1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:19 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:19 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 1073741824
Apr 24 01:14:19 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:19 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:19 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:19 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.564s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:19 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-20eca179-bfdb-43ca-9c82-f087cabae8f1 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-d6394005-119e-4f10-912b-cdbad505a7e6-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-5450d59b-faf5-43a1-ae2a-c93e41e88bab-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-5450d59b-faf5-43a1-ae2a-c93e41e88bab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-5450d59b-faf5-43a1-ae2a-c93e41e88bab" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-5450d59b-faf5-43a1-ae2a-c93e41e88bab" acquired by "delete_volume" :: waited 0.031s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25b9e8-c0fc-4743-b833-a646cb84ea5a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:20 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab
Apr 24 01:14:20 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Acquiring lock "cinder-63dab488-7887-4ed8-af3e-d46d5416ca20-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "cinder-63dab488-7887-4ed8-af3e-d46d5416ca20-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Acquiring lock "cinder-quobyte-63dab488-7887-4ed8-af3e-d46d5416ca20" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "cinder-quobyte-63dab488-7887-4ed8-af3e-d46d5416ca20" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:20 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.013s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e615fec-503b-4e16-94d8-9d0a31188af7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:20 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20
Apr 24 01:14:20 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:20 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 1073741824" returned: 0 in 1.491s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:20 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9
Apr 24 01:14:20 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:21 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab" returned: 0 in 1.446s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:21 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab
Apr 24 01:14:21 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:21 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20" returned: 0 in 1.263s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:21 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20
Apr 24 01:14:21 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:21 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" returned: 0 in 0.967s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.544s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0bec46-3255-4ccc-adb2-aa236a84bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a741d4cd-ecaf-41a7-a1df-8cd1cb36ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:21 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Volume volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 (1c62b9c3-6489-4b41-a5a5-3a4904f33bd9): created successfully
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a741d4cd-ecaf-41a7-a1df-8cd1cb36ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:21 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Flow 'volume_create_manager' (e5f7fdb6-cbc7-44bb-bc33-97031281e020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:21 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a22e2fbb-196c-4e9f-99e7-520c21dab5ea tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Created volume successfully.
Apr 24 01:14:22 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5450d59b-faf5-43a1-ae2a-c93e41e88bab" returned: 0 in 0.726s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-5450d59b-faf5-43a1-ae2a-c93e41e88bab" released by "delete_volume" :: held 2.327s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['7b87e95d-606a-4994-b465-64278d1905a3', '26259665-ddff-416d-b53f-8dc8a13253c9', '97607928-f44f-449d-becc-677d9d33319e', '0f1b5412-14dd-4eaa-bec3-fb2b2b59acbb'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:22 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:22 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:22 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-63dab488-7887-4ed8-af3e-d46d5416ca20" returned: 0 in 0.612s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "cinder-quobyte-63dab488-7887-4ed8-af3e-d46d5416ca20" released by "delete_volume" :: held 1.953s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Created reservations ['031576c3-95d1-45bf-bc90-007320673a42', 'e4cfb12b-028a-461e-b7fb-0794917f5762', '3899e0b2-cd44-4389-aeab-bab03ec9af70', 'c6f1f6ae-de35-4b9c-8073-072d094ed97c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:22 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:22 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:23 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.963s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-b8bef133-ea1e-4093-b64b-13fe053467b9-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2d47f249-1588-4360-9755-1efa11cc64c8 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-5450d59b-faf5-43a1-ae2a-c93e41e88bab-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-b8bef133-ea1e-4093-b64b-13fe053467b9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-b8bef133-ea1e-4093-b64b-13fe053467b9" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-b8bef133-ea1e-4093-b64b-13fe053467b9" acquired by "delete_volume" :: waited 0.077s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a8c32-ad80-4c08-a574-af00d8df7972]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:23 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9
Apr 24 01:14:23 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:23 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:23 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:23 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.441s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Deleted volume successfully.
Apr 24 01:14:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-07da5f92-1902-45bc-8d4e-22fbab039f4c tempest-VolumesServicesTestJSON-1235195270 None] Lock "cinder-63dab488-7887-4ed8-af3e-d46d5416ca20-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:24 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9" returned: 0 in 1.074s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:24 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9
Apr 24 01:14:24 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:24 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.957s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:24 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e9c18af7-d6a5-4e8b-b825-c8ebb8bb9dfe tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Retype volume completed successfully.
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "cinder-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "cinder-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "cinder-quobyte-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "cinder-quobyte-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc276bb-b380-473f-929b-4d3ecf560dd4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:25 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9
Apr 24 01:14:25 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:25 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b8bef133-ea1e-4093-b64b-13fe053467b9" returned: 0 in 1.046s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-b8bef133-ea1e-4093-b64b-13fe053467b9" released by "delete_volume" :: held 2.211s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['b2e1d41d-9cee-4448-8f69-34fb921ad496', '66151902-f7f9-47fd-b9ce-c03960b0dc8c', '5da722fd-c982-4bd8-8dd7-efe6b69696bd', '42d3a3be-1825-4758-ba79-b194d73df7b5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:25 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:25 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:26 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" returned: 0 in 0.907s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:26 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9
Apr 24 01:14:26 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:26 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.669s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:26 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-92301f1b-c08b-4df6-8f7e-4c2f5968a139 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-b8bef133-ea1e-4093-b64b-13fe053467b9-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-3d8da908-abab-49be-ad16-808372677b6b-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:26 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" returned: 0 in 0.589s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-3d8da908-abab-49be-ad16-808372677b6b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "cinder-quobyte-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9" released by "delete_volume" :: held 1.596s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-3d8da908-abab-49be-ad16-808372677b6b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-3d8da908-abab-49be-ad16-808372677b6b" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:26 devstack cinder-volume[81902]: WARNING cinder.quota [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:14:26 devstack cinder-volume[81902]: WARNING cinder.quota [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[9779700d-ed4a-413b-a8cb-d5022656cf47]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Created reservations ['6a01c310-f49f-4c23-8808-97ffc81c62e5', '4131d691-4589-41e4-bd56-0c9226bef04d', 'a24fba04-6ec5-45e8-a7fa-938387fbe3bd', 'd3ea0e1d-d754-48ee-a3a6-72a9cc3f70ea'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:27 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b
Apr 24 01:14:27 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:27 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:27 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:27 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.746s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:27 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Deleted volume successfully.
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4d5f9631-35ef-48da-9246-fdc50beacf89 tempest-VolumeRetypeWithoutMigrationTest-490095308 None] Lock "cinder-1c62b9c3-6489-4b41-a5a5-3a4904f33bd9-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:28 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b" returned: 0 in 1.085s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:28 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b
Apr 24 01:14:28 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:28 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3d8da908-abab-49be-ad16-808372677b6b" returned: 0 in 0.653s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-3d8da908-abab-49be-ad16-808372677b6b" released by "delete_volume" :: held 1.823s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['096240f6-f96f-4433-ada3-a3eeb655e12b', '830c8e94-89a7-4bf5-9342-070f1e616793', '0761885c-2996-494f-8bba-8321b52c12ed', '4f39a299-efd2-451a-90b5-4b5efb18be0e'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:28 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:28 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-084f99eb-9ad1-48b0-a29e-c24815771d0b-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-084f99eb-9ad1-48b0-a29e-c24815771d0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-084f99eb-9ad1-48b0-a29e-c24815771d0b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-084f99eb-9ad1-48b0-a29e-c24815771d0b" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca79f4-3b9b-44e5-998f-bdaddfd14d7f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:29 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b
Apr 24 01:14:29 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:29 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.824s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-59559455-b019-442a-a24e-a1cf28c75f10 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-3d8da908-abab-49be-ad16-808372677b6b-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:30 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b" returned: 0 in 0.840s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:30 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b
Apr 24 01:14:30 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:30 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-084f99eb-9ad1-48b0-a29e-c24815771d0b" returned: 0 in 0.673s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-084f99eb-9ad1-48b0-a29e-c24815771d0b" released by "delete_volume" :: held 1.566s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['93baa399-b874-41f3-9206-a3887480121b', '7609c40e-eb0d-437c-b6aa-9f7dbabc19d2', '9cd1f8f9-9169-4908-9eda-43308726d2e9', '47b0de48-de9f-4293-bc0b-bf08cc829031'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:31 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:31 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-a214d39b-c7c1-4cfd-9709-f10d15a9a14d-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-a214d39b-c7c1-4cfd-9709-f10d15a9a14d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "cinder-quobyte-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[9434011e-2e6b-40ab-8b02-7a634c08b42e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:31 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d
Apr 24 01:14:31 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:31 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.728s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a16f516f-98a8-453a-a7e5-7459dd306842 tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-084f99eb-9ad1-48b0-a29e-c24815771d0b-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:32 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" returned: 0 in 0.750s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:32 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d
Apr 24 01:14:32 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:33 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" returned: 0 in 0.739s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-quobyte-a214d39b-c7c1-4cfd-9709-f10d15a9a14d" released by "delete_volume" :: held 1.546s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Created reservations ['2e40a85f-a433-4a7c-aed4-adc9f9782df9', '9ec51875-15c8-464a-9305-809d316b8216', '6b7e6945-cb54-49b2-a5fe-d11a9c855ec0', '32e2d72d-f5c9-4bd3-9ec8-2e4a98e1b3e6'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:33 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:33 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:34 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.790s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:34 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Deleted volume successfully.
Apr 24 01:14:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-342af7e6-ecf0-4055-acbc-e10dbf4b9e0a tempest-CreateVolumesFromSourceVolumeTest-1371212858 None] Lock "cinder-a214d39b-c7c1-4cfd-9709-f10d15a9a14d-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Flow 'volume_create_manager' (053d489c-4213-4b26-be91-daea3e1c4ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2892b8-0d20-48a6-8f55-27e4d2e0b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2892b8-0d20-48a6-8f55-27e4d2e0b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a8b3a7-1557-447f-b15a-91402e4bd053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa6bbc560654832a4b81f3c045761b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:39Z,use_quota=True,user_id='b4e5d72083bf4c1aaf07a009be0af5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01703e2f-0ec5-47d5-a6c5-a807f4dd7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01703e2f-0ec5-47d5-a6c5-a807f4dd7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db93e3-fdb4-46b9-8faa-695b0acc11c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db93e3-fdb4-46b9-8faa-695b0acc11c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a8b3a7-1557-447f-b15a-91402e4bd053', 'volume_name': 'volume-92a8b3a7-1557-447f-b15a-91402e4bd053', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f79848-f2a9-4d7b-b9dc-db8ca81a433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f79848-f2a9-4d7b-b9dc-db8ca81a433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d535519-8481-46d6-9301-464add0d4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:38 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Volume 92a8b3a7-1557-447f-b15a-91402e4bd053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a8b3a7-1557-447f-b15a-91402e4bd053', 'volume_size': 1}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a8b3a7-1557-447f-b15a-91402e4bd053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa6bbc560654832a4b81f3c045761b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:39Z,use_quota=True,user_id='b4e5d72083bf4c1aaf07a009be0af5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Creating volume 92a8b3a7-1557-447f-b15a-91402e4bd053 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:38 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:39 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 1073741824
Apr 24 01:14:39 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:39 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 1073741824" returned: 0 in 0.835s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:39 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053
Apr 24 01:14:39 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:40 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053" returned: 0 in 0.757s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d535519-8481-46d6-9301-464add0d4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a8b3a7-1557-447f-b15a-91402e4bd053', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144062e1-3f4b-44f4-bbeb-cb3d7d00399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Volume volume-92a8b3a7-1557-447f-b15a-91402e4bd053 (92a8b3a7-1557-447f-b15a-91402e4bd053): created successfully
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144062e1-3f4b-44f4-bbeb-cb3d7d00399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Flow 'volume_create_manager' (053d489c-4213-4b26-be91-daea3e1c4ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5fcda117-ff30-4cd0-80e9-b4f14ba4659f tempest-CinderUnicodeTest-1257646609 None] Created volume successfully.
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Flow 'volume_create_manager' (e9e9b54d-59a7-4d2b-b4c8-d3ee00f646d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1309458-6beb-4de2-8295-f60a3eb25038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1309458-6beb-4de2-8295-f60a3eb25038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-526639153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b7ac1c-50f6-4af0-9f0b-1f42307feb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa6bbc560654832a4b81f3c045761b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:42Z,use_quota=True,user_id='b4e5d72083bf4c1aaf07a009be0af5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3fc30-02bf-4f72-b047-9a7ec4cf0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3fc30-02bf-4f72-b047-9a7ec4cf0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b8b102-3c28-44e7-99ce-5757d39a9caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b8b102-3c28-44e7-99ce-5757d39a9caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b7ac1c-50f6-4af0-9f0b-1f42307feb1b', 'volume_name': 'volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bd777f-e519-45a2-b8fc-8eddec819779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bd777f-e519-45a2-b8fc-8eddec819779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca4cbe5-bcd7-4f2b-a98a-7196a0e3ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Volume 34b7ac1c-50f6-4af0-9f0b-1f42307feb1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b', 'volume_size': 1}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-526639153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b7ac1c-50f6-4af0-9f0b-1f42307feb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa6bbc560654832a4b81f3c045761b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:42Z,use_quota=True,user_id='b4e5d72083bf4c1aaf07a009be0af5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Creating volume 34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:41 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Acquiring lock "cinder-23781ada-3e99-4b7a-846d-f57114437e65-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "cinder-23781ada-3e99-4b7a-846d-f57114437e65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:41 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b 1073741824
Apr 24 01:14:41 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Acquiring lock "cinder-quobyte-23781ada-3e99-4b7a-846d-f57114437e65" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "cinder-quobyte-23781ada-3e99-4b7a-846d-f57114437e65" acquired by "delete_volume" :: waited 0.052s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7a229-4581-4162-a7cc-ce8dd5a3d2c6]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:42 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65
Apr 24 01:14:42 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:42 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b 1073741824" returned: 0 in 0.993s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:42 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65" returned: 0 in 0.819s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:42 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65
Apr 24 01:14:42 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:42 devstack sudo[88310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b
Apr 24 01:14:42 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:43 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-23781ada-3e99-4b7a-846d-f57114437e65" returned: 0 in 0.606s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "cinder-quobyte-23781ada-3e99-4b7a-846d-f57114437e65" released by "delete_volume" :: held 1.486s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Created reservations ['ee2bd05e-f0f7-4e4e-b7a7-824380e76925', '587cfd15-5489-468b-8f54-83b97612040f', '1be41ac8-eeb3-4bb3-891b-0d018bcdde00', '3c03c80e-7e7f-464e-95be-6e25ef7d8444'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:43 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" returned: 0 in 0.711s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca4cbe5-bcd7-4f2b-a98a-7196a0e3ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcee09a-4f59-410f-b1f1-cd095a5ed9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Volume volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b (34b7ac1c-50f6-4af0-9f0b-1f42307feb1b): created successfully
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcee09a-4f59-410f-b1f1-cd095a5ed9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Flow 'volume_create_manager' (e9e9b54d-59a7-4d2b-b4c8-d3ee00f646d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-494b2532-48e2-482a-a7c2-11c0453dd8af tempest-CinderUnicodeTest-1257646609 None] Created volume successfully.
Apr 24 01:14:43 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:43 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Creating offline snapshot a74da5e3-1029-4ec8-b749-4941b464f795 of volume 34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3645cfe-ea2f-478c-9311-7b775abaf846]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:44 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b
Apr 24 01:14:44 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:44 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.888s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Deleted volume successfully.
Apr 24 01:14:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-84558999-4f54-48c6-a689-78ae8c513337 tempest-VolumesNegativeTest-265530867 None] Lock "cinder-23781ada-3e99-4b7a-846d-f57114437e65-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:45 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" returned: 0 in 0.817s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:45 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 1G
Apr 24 01:14:45 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:45 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 1G" returned: 0 in 0.943s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:46 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795
Apr 24 01:14:46 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:46 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795" returned: 0 in 0.700s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:46 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 is being set with open permissions: ugo+rw
Apr 24 01:14:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:46 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795
Apr 24 01:14:46 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:47 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795" returned: 0 in 0.644s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:47 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info
Apr 24 01:14:47 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:48 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info" returned: 0 in 0.787s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:48 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info is being set with open permissions: ugo+rw
Apr 24 01:14:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:48 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info
Apr 24 01:14:48 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:48 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.info" returned: 0 in 0.738s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-be6983ab-b78b-436e-a55d-50e9cd081971 tempest-CinderUnicodeTest-1257646609 None] Create snapshot completed successfully
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-a74da5e3-1029-4ec8-b749-4941b464f795-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-a74da5e3-1029-4ec8-b749-4941b464f795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-quobyte-a74da5e3-1029-4ec8-b749-4941b464f795" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-a74da5e3-1029-4ec8-b749-4941b464f795" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Deleting offline snapshot a74da5e3-1029-4ec8-b749-4941b464f795 of volume 34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] snapshot_file for this snap is: volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdac5b8-c8b7-4def-a230-778ecc425fd5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:49 devstack sudo[88343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795
Apr 24 01:14:49 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Flow 'volume_create_manager' (d43865a9-c1be-442c-bb1e-b4f7a3c3b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456092d1-26b2-4d5e-bb3f-fde7efaef18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456092d1-26b2-4d5e-bb3f-fde7efaef18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796290939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51e1bc6-8345-4743-b835-5b0371d291bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57db1f9994f4753a6df77c259b11ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:50Z,use_quota=True,user_id='97ff726709d64e3e9298ebfdee117375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce672cd-7ee9-4123-ad1c-13a52a9aa74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce672cd-7ee9-4123-ad1c-13a52a9aa74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6641c5b6-3806-4174-90fc-ab72d8fef69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6641c5b6-3806-4174-90fc-ab72d8fef69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51e1bc6-8345-4743-b835-5b0371d291bb', 'volume_name': 'volume-b51e1bc6-8345-4743-b835-5b0371d291bb', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d35a0d-944c-4fb1-9042-57817af8fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d35a0d-944c-4fb1-9042-57817af8fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1a31a6-339d-4790-b87d-1979bdd015e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:50 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Volume b51e1bc6-8345-4743-b835-5b0371d291bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51e1bc6-8345-4743-b835-5b0371d291bb', 'volume_size': 1}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796290939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51e1bc6-8345-4743-b835-5b0371d291bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57db1f9994f4753a6df77c259b11ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:50Z,use_quota=True,user_id='97ff726709d64e3e9298ebfdee117375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Creating volume b51e1bc6-8345-4743-b835-5b0371d291bb {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:50 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:50 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb 1073741824
Apr 24 01:14:50 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:50 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795" returned: 0 in 0.793s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[776a0c89-dc57-4a50-a9b6-1e06daa1b431]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:50 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b
Apr 24 01:14:50 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:51 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb 1073741824" returned: 0 in 0.781s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:51 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb
Apr 24 01:14:51 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:51 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" returned: 0 in 0.937s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:51 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795
Apr 24 01:14:51 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:51 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb" returned: 0 in 0.660s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1a31a6-339d-4790-b87d-1979bdd015e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51e1bc6-8345-4743-b835-5b0371d291bb', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8841f3-a356-4758-be6e-a981db724567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Volume volume-b51e1bc6-8345-4743-b835-5b0371d291bb (b51e1bc6-8345-4743-b835-5b0371d291bb): created successfully
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8841f3-a356-4758-be6e-a981db724567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Flow 'volume_create_manager' (d43865a9-c1be-442c-bb1e-b4f7a3c3b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1971779b-77bd-4b31-9019-647f94b468c8 tempest-VolumesTransfersV357Test-75355416 None] Created volume successfully.
Apr 24 01:14:52 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795" returned: 0 in 0.844s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:52 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795
Apr 24 01:14:52 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:53 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b.a74da5e3-1029-4ec8-b749-4941b464f795" returned: 0 in 0.756s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-a74da5e3-1029-4ec8-b749-4941b464f795" released by "_delete_snapshot" :: held 3.493s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" released by "delete_snapshot" :: held 3.528s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Created reservations ['e9f02ea3-4720-42e6-ba4a-627950a24a78', '37b30818-dd23-4cb3-9f0f-4474beb3abd7', '22494a06-acd6-4438-81cd-b224d4f67a9c', '36bfcaff-bd80-4c14-b346-66400e37749b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Delete snapshot completed successfully.
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-967df8e5-450c-4cc2-99ae-e942403de121 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-a74da5e3-1029-4ec8-b749-4941b464f795-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f51cfdc2-5fe4-4d17-b010-641c3516601f tempest-VolumesTransfersV357Test-1818969257 None] Transfer volume completed successfully.
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[11596c87-74d9-489a-955a-1f53cab63750]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:54 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b
Apr 24 01:14:54 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "cinder-b51e1bc6-8345-4743-b835-5b0371d291bb-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-b51e1bc6-8345-4743-b835-5b0371d291bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "cinder-quobyte-b51e1bc6-8345-4743-b835-5b0371d291bb" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-quobyte-b51e1bc6-8345-4743-b835-5b0371d291bb" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb8463-13a1-4043-af45-f758ccb8e6cb]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:54 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb
Apr 24 01:14:54 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:54 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" returned: 0 in 0.886s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:54 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b
Apr 24 01:14:54 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:55 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" returned: 0 in 0.847s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b" released by "delete_volume" :: held 1.810s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:55 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb" returned: 0 in 0.993s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Created reservations ['2fcc18dd-8242-44ff-bd8f-6e8c9f0a52ec', 'c6e49ba7-4b1e-47c8-8615-bf44e1395c00', '4a5c0af7-74d1-42c9-938e-9b052b1a8885', '47d1d203-5f9a-43be-b18f-1795643a734c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:55 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb
Apr 24 01:14:55 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:55 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:55 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-92a8b3a7-1557-447f-b15a-91402e4bd053-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-92a8b3a7-1557-447f-b15a-91402e4bd053-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "cinder-quobyte-92a8b3a7-1557-447f-b15a-91402e4bd053" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-92a8b3a7-1557-447f-b15a-91402e4bd053" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3073c-15bc-4b68-9dee-0eea01884eb2]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:56 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053
Apr 24 01:14:56 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:56 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.924s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:56 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Deleted volume successfully.
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-19bfd447-cead-4c84-b058-1f8cb0ee41d4 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-34b7ac1c-50f6-4af0-9f0b-1f42307feb1b-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:56 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b51e1bc6-8345-4743-b835-5b0371d291bb" returned: 0 in 1.215s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-quobyte-b51e1bc6-8345-4743-b835-5b0371d291bb" released by "delete_volume" :: held 2.277s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Created reservations ['601a3f18-51f0-44ca-9f2d-452bf5e75e72', '8ad3b6d6-0517-4538-913e-d68670af0a89', 'a494ec47-4e62-46e9-bbfe-0e78624ed847', 'a6b416a1-2ef7-41ad-bc85-5ade837e0d5e'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:57 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:57 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:57 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053" returned: 0 in 1.249s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:57 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053
Apr 24 01:14:57 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:58 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.836s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Deleted volume successfully.
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab96490e-b42b-48b3-bd9b-ce7707179d79 tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-b51e1bc6-8345-4743-b835-5b0371d291bb-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:58 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-92a8b3a7-1557-447f-b15a-91402e4bd053" returned: 0 in 0.707s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-quobyte-92a8b3a7-1557-447f-b15a-91402e4bd053" released by "delete_volume" :: held 2.017s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Created reservations ['88795a73-9163-45a2-a360-0605182cab27', '04818df5-caca-44df-9933-7779795bd23b', '203387ef-0e25-435c-9aee-957cdc26187a', 'ad93489e-66ea-4f49-82dc-76013f0ba6f6'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:58 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:14:58 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Flow 'volume_create_manager' (3bf4578f-92b4-4dab-bb92-8ded3cca12e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b24a459-3a38-41ec-850f-8fb259c15006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b24a459-3a38-41ec-850f-8fb259c15006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1268120988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf29fe98-f63d-41c8-b49a-bab7be51cf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57db1f9994f4753a6df77c259b11ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:59Z,use_quota=True,user_id='97ff726709d64e3e9298ebfdee117375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e98daff-5f72-4c8f-a4de-c2f3865073dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e98daff-5f72-4c8f-a4de-c2f3865073dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9457a88-6597-44ac-97e3-4509a33a0b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9457a88-6597-44ac-97e3-4509a33a0b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf29fe98-f63d-41c8-b49a-bab7be51cf53', 'volume_name': 'volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1ad26e-4a72-46f1-a2d0-13bdd279f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1ad26e-4a72-46f1-a2d0-13bdd279f297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fb7fdc-1895-4eb5-b7cb-2831d4bed06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:14:58 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Volume bf29fe98-f63d-41c8-b49a-bab7be51cf53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53', 'volume_size': 1}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1268120988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf29fe98-f63d-41c8-b49a-bab7be51cf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57db1f9994f4753a6df77c259b11ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:59Z,use_quota=True,user_id='97ff726709d64e3e9298ebfdee117375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Creating volume bf29fe98-f63d-41c8-b49a-bab7be51cf53 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:14:58 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:14:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:14:59 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 1073741824
Apr 24 01:14:59 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:14:59 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 24 01:14:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.924s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:14:59 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:14:59 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Deleted volume successfully.
Apr 24 01:14:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a8463d74-5034-4027-b8c8-fdc4849f78b6 tempest-CinderUnicodeTest-1257646609 None] Lock "cinder-92a8b3a7-1557-447f-b15a-91402e4bd053-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:00 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 1073741824" returned: 0 in 1.054s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:00 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53
Apr 24 01:15:00 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:00 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53" returned: 0 in 0.570s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fb7fdc-1895-4eb5-b7cb-2831d4bed06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b774010a-06e0-4e7c-8fb5-dc7c7afb7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:00 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Volume volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 (bf29fe98-f63d-41c8-b49a-bab7be51cf53): created successfully
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b774010a-06e0-4e7c-8fb5-dc7c7afb7129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Flow 'volume_create_manager' (3bf4578f-92b4-4dab-bb92-8ded3cca12e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5d4bffdf-73d3-430d-bbdd-dfb9b613709b tempest-VolumesTransfersV357Test-75355416 None] Created volume successfully.
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "cinder-bf29fe98-f63d-41c8-b49a-bab7be51cf53-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-bf29fe98-f63d-41c8-b49a-bab7be51cf53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "cinder-quobyte-bf29fe98-f63d-41c8-b49a-bab7be51cf53" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-quobyte-bf29fe98-f63d-41c8-b49a-bab7be51cf53" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cff96f-557b-4677-af92-7206ee3d6e3a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:01 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53
Apr 24 01:15:01 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:02 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53" returned: 0 in 0.732s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:02 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53
Apr 24 01:15:02 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:03 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bf29fe98-f63d-41c8-b49a-bab7be51cf53" returned: 0 in 0.856s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-quobyte-bf29fe98-f63d-41c8-b49a-bab7be51cf53" released by "delete_volume" :: held 1.660s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Created reservations ['6f150c83-84e5-4273-a912-e36776bf394a', '19db7657-6556-46b8-a79b-83700677c976', 'ff676e6f-d6fb-40e2-807b-f732de275eb5', 'eea4ffdf-84e3-4823-906b-018f51631322'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:03 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:03 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:04 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.923s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:04 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Deleted volume successfully.
Apr 24 01:15:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ba515f8d-b07b-4c71-b43e-573e31bfd4bb tempest-VolumesTransfersV357Test-852108158 None] Lock "cinder-bf29fe98-f63d-41c8-b49a-bab7be51cf53-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (03e65733-b2df-43be-855a-36225c7259cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7de000-fff0-4aa0-8053-1308ff845693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7de000-fff0-4aa0-8053-1308ff845693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1172806040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2973c9c-8c62-4ebf-ad95-8bd92c543a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:05Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a13f0-76c7-4272-91e4-bcdb1992728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a13f0-76c7-4272-91e4-bcdb1992728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac9cdfe-b93c-483d-9198-43a6aaf8373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac9cdfe-b93c-483d-9198-43a6aaf8373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2973c9c-8c62-4ebf-ad95-8bd92c543a13', 'volume_name': 'volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca78ee4-37bf-4599-b390-067e76cb78c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca78ee4-37bf-4599-b390-067e76cb78c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de83251-157a-40ba-bcef-2c03792a4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:05 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume e2973c9c-8c62-4ebf-ad95-8bd92c543a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13', 'volume_size': 1}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1172806040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2973c9c-8c62-4ebf-ad95-8bd92c543a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:05Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating volume e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:05 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:05 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 1073741824
Apr 24 01:15:05 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:06 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 1073741824" returned: 0 in 0.786s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:06 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13
Apr 24 01:15:06 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:06 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de83251-157a-40ba-bcef-2c03792a4301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2353e69a-a1ff-49d8-a0eb-1854bbd11e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:07 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 (e2973c9c-8c62-4ebf-ad95-8bd92c543a13): created successfully
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2353e69a-a1ff-49d8-a0eb-1854bbd11e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (03e65733-b2df-43be-855a-36225c7259cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b13f8475-e12c-45fa-9b6a-1eaae0135089 tempest-VolumesSnapshotTestJSON-1613464410 None] Created volume successfully.
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Creating offline snapshot ed030f03-8f60-46d6-92c9-14244e670cf0 of volume e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266fe42-11ba-4736-9758-89c96bc975ff]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:08 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13
Apr 24 01:15:08 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:08 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" returned: 0 in 0.611s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:08 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 1G
Apr 24 01:15:08 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:09 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 1G" returned: 0 in 0.728s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:09 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0
Apr 24 01:15:09 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:10 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0" returned: 0 in 0.773s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:10 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 is being set with open permissions: ugo+rw
Apr 24 01:15:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:10 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0
Apr 24 01:15:10 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:10 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0" returned: 0 in 0.647s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:10 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info
Apr 24 01:15:10 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:11 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info" returned: 0 in 0.770s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:11 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info is being set with open permissions: ugo+rw
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:11 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info
Apr 24 01:15:11 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Flow 'volume_create_manager' (1729986a-2f8e-44a1-9799-f7575b521194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97add89c-e7be-4e50-90ce-520109a7b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97add89c-e7be-4e50-90ce-520109a7b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1867245658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad95c55c-84b7-43fe-9340-194a48fe71d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8cf55a822a4ec0b447be8223ed1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:12Z,use_quota=True,user_id='efaea6c44b7d4b3b9603d58e9ce076ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d17392-efd0-40ff-bbf2-404a1a059a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d17392-efd0-40ff-bbf2-404a1a059a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91100a27-5f8b-4d4b-993b-24aafc697814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91100a27-5f8b-4d4b-993b-24aafc697814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad95c55c-84b7-43fe-9340-194a48fe71d3', 'volume_name': 'volume-ad95c55c-84b7-43fe-9340-194a48fe71d3', 'volume_size': 2}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f426d7f7-074e-41ec-860d-01d20d4acac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f426d7f7-074e-41ec-860d-01d20d4acac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fcaf49-faaa-418d-aba3-c666d658134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:11 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Volume ad95c55c-84b7-43fe-9340-194a48fe71d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad95c55c-84b7-43fe-9340-194a48fe71d3', 'volume_size': 2}
Apr 24 01:15:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:12 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.info" returned: 0 in 0.671s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1867245658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad95c55c-84b7-43fe-9340-194a48fe71d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8cf55a822a4ec0b447be8223ed1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:12Z,use_quota=True,user_id='efaea6c44b7d4b3b9603d58e9ce076ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Creating volume ad95c55c-84b7-43fe-9340-194a48fe71d3 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:12 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 2147483648 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=150,cinder:SELECT=92,cinder:DELETE=13,cinder:INSERT=34 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:15:12 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 2147483648
Apr 24 01:15:12 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=114,cinder:UPDATE=143,cinder:INSERT=34,cinder:DELETE=12 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:15:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-754c8c39-88f5-4b34-9f2d-e9d5deeefc5b tempest-VolumesSnapshotTestJSON-1613464410 None] Create snapshot completed successfully
Apr 24 01:15:13 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 2147483648" returned: 0 in 0.841s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:13 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3
Apr 24 01:15:13 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-ed030f03-8f60-46d6-92c9-14244e670cf0-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-ed030f03-8f60-46d6-92c9-14244e670cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-ed030f03-8f60-46d6-92c9-14244e670cf0" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-ed030f03-8f60-46d6-92c9-14244e670cf0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleting offline snapshot ed030f03-8f60-46d6-92c9-14244e670cf0 of volume e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] snapshot_file for this snap is: volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[65512c22-eccd-4e19-9a0f-9753faf72481]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:13 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0
Apr 24 01:15:13 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:13 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3" returned: 0 in 0.788s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fcaf49-faaa-418d-aba3-c666d658134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad95c55c-84b7-43fe-9340-194a48fe71d3', 'volume_size': 2}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eca9f27-6a51-4e95-a146-fa838ab35405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:14 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Volume volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 (ad95c55c-84b7-43fe-9340-194a48fe71d3): created successfully
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eca9f27-6a51-4e95-a146-fa838ab35405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Flow 'volume_create_manager' (1729986a-2f8e-44a1-9799-f7575b521194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:14 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-16f2ec59-4ac5-4e4a-b0ba-98d65a8d20ec tempest-VolumesCloneNegativeTest-2136597710 None] Created volume successfully.
Apr 24 01:15:14 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0" returned: 0 in 0.825s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e93827-d04f-41cf-ba1c-d81163ab5360]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:14 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13
Apr 24 01:15:14 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:15 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" returned: 0 in 0.800s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Acquiring lock "cinder-ad95c55c-84b7-43fe-9340-194a48fe71d3-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:15 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0
Apr 24 01:15:15 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "cinder-ad95c55c-84b7-43fe-9340-194a48fe71d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Acquiring lock "cinder-quobyte-ad95c55c-84b7-43fe-9340-194a48fe71d3" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "cinder-quobyte-ad95c55c-84b7-43fe-9340-194a48fe71d3" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e243d8-64af-4d38-b34a-2b11723dfa66]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:15 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3
Apr 24 01:15:15 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:15 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0" returned: 0 in 0.705s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:15 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0
Apr 24 01:15:15 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:16 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3" returned: 0 in 0.649s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:16 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3
Apr 24 01:15:16 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:16 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13.ed030f03-8f60-46d6-92c9-14244e670cf0" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-ed030f03-8f60-46d6-92c9-14244e670cf0" released by "_delete_snapshot" :: held 3.012s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" released by "delete_snapshot" :: held 3.038s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:16 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad95c55c-84b7-43fe-9340-194a48fe71d3" returned: 0 in 0.564s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "cinder-quobyte-ad95c55c-84b7-43fe-9340-194a48fe71d3" released by "delete_volume" :: held 1.258s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['2af96c4a-b91c-45d0-be79-95f47792ff0d', 'c0c49664-3f74-4ae3-ba62-33a117a4df70', '611ab823-6790-42e6-ba5e-814a0d6041b0', '597d5f48-13c9-44ed-bc77-3ff902d3fc43'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Created reservations ['c05f1a38-64ca-4bfb-b9d2-abdcdfa3792d', '09b5fef1-eeae-453c-bd64-2d2d4a1f1b11', 'ea18fb44-a2d1-4b4c-8330-00133c0ff603', 'c78c6877-0a8f-4a14-b580-8811ce0241ae'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Delete snapshot completed successfully.
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f8d65e18-f84f-4fb9-bf16-0b22c197cdb2 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-ed030f03-8f60-46d6-92c9-14244e670cf0-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:16 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:16 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:17 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.512s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:17 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Deleted volume successfully.
Apr 24 01:15:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2799fa24-d0d9-4283-bd58-471bab65fd15 tempest-VolumesCloneNegativeTest-2136597710 None] Lock "cinder-ad95c55c-84b7-43fe-9340-194a48fe71d3-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (175f4c7a-cb00-4afb-aaa8-1bf964e0300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d18a5e-feea-4519-9233-e7046d7d6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d18a5e-feea-4519-9233-e7046d7d6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-781088034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787f0650-fd18-469f-b709-0f0b9a384086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:18Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e21f51-c4e3-488a-a9a9-69f8b3ecb4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e21f51-c4e3-488a-a9a9-69f8b3ecb4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63740e7c-398b-4fd9-a034-d63814e95b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63740e7c-398b-4fd9-a034-d63814e95b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787f0650-fd18-469f-b709-0f0b9a384086', 'volume_name': 'volume-787f0650-fd18-469f-b709-0f0b9a384086', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd73aa-c2bd-419d-9a6c-d0c925f55a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd73aa-c2bd-419d-9a6c-d0c925f55a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81eca0de-943a-44cf-bfc3-cec8a97463fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:18 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume 787f0650-fd18-469f-b709-0f0b9a384086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787f0650-fd18-469f-b709-0f0b9a384086', 'volume_size': 1}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-781088034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787f0650-fd18-469f-b709-0f0b9a384086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:18Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating volume 787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:18 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:18 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 1073741824
Apr 24 01:15:18 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:19 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 1073741824" returned: 0 in 0.760s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:19 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:19 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:19 devstack sudo[88515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:19 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:19 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.516s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81eca0de-943a-44cf-bfc3-cec8a97463fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787f0650-fd18-469f-b709-0f0b9a384086', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbacd59-ba1a-4266-b87a-5c3741112039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:19 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume volume-787f0650-fd18-469f-b709-0f0b9a384086 (787f0650-fd18-469f-b709-0f0b9a384086): created successfully
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbacd59-ba1a-4266-b87a-5c3741112039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (175f4c7a-cb00-4afb-aaa8-1bf964e0300f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:19 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6bf0fb2a-69f0-48fa-8f53-0d7b2c695923 tempest-VolumesSnapshotTestJSON-1613464410 None] Created volume successfully.
Apr 24 01:15:19 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.636s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating offline snapshot 1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a of volume 787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08046d-75ca-401c-aa09-d12cb75c8f3b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:20 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:20 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Flow 'volume_create_manager' (59bc3c40-9f8f-4015-91ee-a007859c0fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4f1fd-ef71-4fcf-814e-3a58d02c9930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4f1fd-ef71-4fcf-814e-3a58d02c9930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-341174289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46911a9-b1d6-46fe-a754-51d584d8420f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8b03901dec4b978f6d8db1a9e44050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:21Z,use_quota=True,user_id='0dc69d0dab0f4fa184d56f4c0434e53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9019cf-d309-4b21-906a-f1cdd087abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9019cf-d309-4b21-906a-f1cdd087abfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce557ae-43ed-4f0e-90b9-7642aabbb0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce557ae-43ed-4f0e-90b9-7642aabbb0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46911a9-b1d6-46fe-a754-51d584d8420f', 'volume_name': 'volume-d46911a9-b1d6-46fe-a754-51d584d8420f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffb4bce-e59f-4906-94da-49d665bafb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffb4bce-e59f-4906-94da-49d665bafb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c8860e-faaf-4527-b857-82839f265da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Volume d46911a9-b1d6-46fe-a754-51d584d8420f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46911a9-b1d6-46fe-a754-51d584d8420f', 'volume_size': 1}
Apr 24 01:15:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:21 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.804s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:21 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a 1G
Apr 24 01:15:21 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:22 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a 1G" returned: 0 in 0.696s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787f0650-fd18-469f-b709-0f0b9a384086 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:22 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787f0650-fd18-469f-b709-0f0b9a384086 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:22 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:22 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787f0650-fd18-469f-b709-0f0b9a384086 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.565s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:22 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a is being set with open permissions: ugo+rw
Apr 24 01:15:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:22 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:22 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:23 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.508s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:23 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info
Apr 24 01:15:23 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:23 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info" returned: 0 in 0.507s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:23 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info is being set with open permissions: ugo+rw
Apr 24 01:15:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:23 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info
Apr 24 01:15:23 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:24 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.info" returned: 0 in 0.581s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.765s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.466s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-341174289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46911a9-b1d6-46fe-a754-51d584d8420f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8b03901dec4b978f6d8db1a9e44050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:21Z,use_quota=True,user_id='0dc69d0dab0f4fa184d56f4c0434e53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Creating volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:24 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:24 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f 1073741824
Apr 24 01:15:24 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-756536a3-148e-4c41-a149-c0797c652242 tempest-VolumesSnapshotTestJSON-1613464410 None] Create snapshot completed successfully
Apr 24 01:15:25 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f 1073741824" returned: 0 in 0.766s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:25 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f
Apr 24 01:15:25 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (e529d2d5-e521-474d-ae50-f73e1385ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efe888-42e9-4f7b-9d97-4bf33c86817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efe888-42e9-4f7b-9d97-4bf33c86817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1519698591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98efb980-13a6-4ff4-9766-54beb06a1524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:25Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780ffe9b-5019-489b-8c07-adba07c7a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780ffe9b-5019-489b-8c07-adba07c7a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d186b27-1be0-40d2-a95e-6154eaf11663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d186b27-1be0-40d2-a95e-6154eaf11663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98efb980-13a6-4ff4-9766-54beb06a1524', 'volume_name': 'volume-98efb980-13a6-4ff4-9766-54beb06a1524', 'volume_size': 2, 'snapshot_id': '1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5b4b8-1a15-469f-bee0-96386e91961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5b4b8-1a15-469f-bee0-96386e91961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a897bd70-2f4d-4ef2-ad91-64b3daf536bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume 98efb980-13a6-4ff4-9766-54beb06a1524: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98efb980-13a6-4ff4-9766-54beb06a1524', 'volume_size': 2, 'snapshot_id': '1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a'}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:25 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f" returned: 0 in 0.496s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.287s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-98efb980-13a6-4ff4-9766-54beb06a1524" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c8860e-faaf-4527-b857-82839f265da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46911a9-b1d6-46fe-a754-51d584d8420f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159ea9b8-a52d-4b44-89ff-d95091dd2eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Volume volume-d46911a9-b1d6-46fe-a754-51d584d8420f (d46911a9-b1d6-46fe-a754-51d584d8420f): created successfully
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159ea9b8-a52d-4b44-89ff-d95091dd2eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Flow 'volume_create_manager' (59bc3c40-9f8f-4015-91ee-a007859c0fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-98efb980-13a6-4ff4-9766-54beb06a1524" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating volume 98efb980-13a6-4ff4-9766-54beb06a1524 from snapshot 1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e0e23b78-0333-4c4a-9156-307827c5b16f tempest-VolumesSnapshotListTestJSON-814426362 None] Created volume successfully.
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] snapshot: 1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a, volume: 98efb980-13a6-4ff4-9766-54beb06a1524,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec92cb-3989-4e59-94ce-8ae73a4466d8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:25 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:25 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:26 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.688s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787f0650-fd18-469f-b709-0f0b9a384086(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2bee79-503d-4f8a-9074-4fde52be4cd0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:26 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:26 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:27 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.570s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:27 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:15:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:27 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524
Apr 24 01:15:27 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:34 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524" returned: 0 in 7.379s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:34 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bfe6c1-4caa-4be3-b4b9-d827c198f0f8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:34 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:34 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:34 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (1d0c6454-4875-4ce1-ae02-ad0f53b38d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9696f97e-0254-4489-9e97-353a3ec13606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9696f97e-0254-4489-9e97-353a3ec13606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666121385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e9c167-d44f-412e-b627-e6aa8a658f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:35Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb7bac8-e258-49ac-8343-c725dc3246a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb7bac8-e258-49ac-8343-c725dc3246a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc84bb3-f893-439a-a82e-3a578c984bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc84bb3-f893-439a-a82e-3a578c984bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e9c167-d44f-412e-b627-e6aa8a658f54', 'volume_name': 'volume-50e9c167-d44f-412e-b627-e6aa8a658f54', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e994de6-af26-403f-9335-cce9a6f6fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e994de6-af26-403f-9335-cce9a6f6fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fbaeb6-dc2f-4664-ba46-e9a557e328ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:35 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Volume 50e9c167-d44f-412e-b627-e6aa8a658f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e9c167-d44f-412e-b627-e6aa8a658f54', 'volume_size': 1}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:35 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.837s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:15:35 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Converted 1024.00 MB image at 138.72 MB/s
Apr 24 01:15:35 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 is being set with open permissions: ugo+rw
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:35 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524
Apr 24 01:15:35 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:35 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:35 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" released by "_copy_volume_from_snapshot" :: held 10.176s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-98efb980-13a6-4ff4-9766-54beb06a1524" released by "_create_volume_from_snapshot" :: held 10.236s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.289s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.580s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Creating offline snapshot 6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a897bd70-2f4d-4ef2-ad91-64b3daf536bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98efb980-13a6-4ff4-9766-54beb06a1524', 'volume_size': 2, 'snapshot_id': '1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec85154-3644-4c83-abc9-7cd570c80c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec5f7a-8dd2-43aa-bd0f-67c86d39a08c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:36 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume volume-98efb980-13a6-4ff4-9766-54beb06a1524 (98efb980-13a6-4ff4-9766-54beb06a1524): created successfully
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec85154-3644-4c83-abc9-7cd570c80c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (e529d2d5-e521-474d-ae50-f73e1385ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-69e9e035-6634-4433-92d6-3b3eebc54502 tempest-VolumesSnapshotTestJSON-1613464410 None] Created volume successfully.
Apr 24 01:15:36 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f
Apr 24 01:15:36 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:36 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f" returned: 0 in 0.716s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:36 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 1G
Apr 24 01:15:36 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-98efb980-13a6-4ff4-9766-54beb06a1524-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-98efb980-13a6-4ff4-9766-54beb06a1524-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1f526-15b7-4a5d-b5f6-92501a9f11b0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:37 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524
Apr 24 01:15:37 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:37 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 1G" returned: 0 in 0.881s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:37 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:37 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:37 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524" returned: 0 in 0.708s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:37 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524
Apr 24 01:15:37 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:38 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 0.682s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:38 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 is being set with open permissions: ugo+rw
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:38 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-98efb980-13a6-4ff4-9766-54beb06a1524" returned: 0 in 0.630s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-98efb980-13a6-4ff4-9766-54beb06a1524" released by "delete_volume" :: held 1.394s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:38 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:38 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['3f2c9271-822e-4d7a-89c7-e0c807d34d8d', 'de0a546b-871b-41ab-9bf1-55adbd6ba4b9', '4df90d1e-788d-49ed-9dc0-50d1bf28be69', '2298ce12-caec-4e59-ac3d-b762b704c45b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:38 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:38 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:38 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 0.524s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:38 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info
Apr 24 01:15:38 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:39 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.554s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleted volume successfully.
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d3a0b196-e524-4eac-bf23-fc47cca5adc4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-98efb980-13a6-4ff4-9766-54beb06a1524-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleting offline snapshot 1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a of volume 787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] snapshot_file for this snap is: volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f233dd6-5167-4987-897b-f82eb2058e2f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:39 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:39 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:39 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info" returned: 0 in 0.671s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:39 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info is being set with open permissions: ugo+rw
Apr 24 01:15:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:39 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info
Apr 24 01:15:39 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:40 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.611s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787f0650-fd18-469f-b709-0f0b9a384086(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[704bc28c-079d-4f9a-b1d1-1a214bbb6563]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:40 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.info" returned: 0 in 0.520s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.120s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.053s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666121385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e9c167-d44f-412e-b627-e6aa8a658f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:35Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Creating volume 50e9c167-d44f-412e-b627-e6aa8a658f54 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:40 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:40 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:40 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:40 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 1073741824
Apr 24 01:15:40 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-41c3a15d-de35-4d94-a49b-dd79aeb65765 tempest-VolumesSnapshotListTestJSON-814426362 None] Create snapshot completed successfully
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:40 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.738s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:40 devstack sudo[88733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:40 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:40 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 1073741824" returned: 0 in 0.753s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:40 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54
Apr 24 01:15:40 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:41 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54" returned: 0 in 0.545s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.844s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fbaeb6-dc2f-4664-ba46-e9a557e328ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e9c167-d44f-412e-b627-e6aa8a658f54', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111a427c-2706-4b5b-a659-8ac1931ccd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Creating offline snapshot 4bef6d57-398e-4db2-bfd3-f4d01136ad1d of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:41 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Volume volume-50e9c167-d44f-412e-b627-e6aa8a658f54 (50e9c167-d44f-412e-b627-e6aa8a658f54): created successfully
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111a427c-2706-4b5b-a659-8ac1931ccd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (1d0c6454-4875-4ce1-ae02-ad0f53b38d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0765f6b-003a-4be6-9714-6a1cf22a46b0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.822s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-67df7eb5-d2a7-4970-b62f-de041ee424dc tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:15:41 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a
Apr 24 01:15:41 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:41 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:41 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:42 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086.1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" returned: 0 in 0.562s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a" released by "_delete_snapshot" :: held 2.867s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" released by "delete_snapshot" :: held 2.902s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['39bf6334-a136-4e73-b192-08305ebc057a', '63ba5fdc-816f-4045-96ac-e1b2dff8da1c', 'b403d71a-3fd4-4c95-b7b2-d2870afb2edd', '4e6857de-931f-4d35-9384-98d8dcc2db8a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:42 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 0.734s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:42 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d 1G
Apr 24 01:15:42 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Delete snapshot completed successfully.
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c2b89a54-f3a4-47b2-8293-6c826c8b53b1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-1bfaec6e-cd2d-42a6-b146-3d5f3035eb8a-delete_snapshot" released by "delete_snapshot" :: held 3.130s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2cb310a5-610e-4733-a4e3-fbd9fa10e821 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54" by "attach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2cb310a5-610e-4733-a4e3-fbd9fa10e821 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54" acquired by "attach_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2cb310a5-610e-4733-a4e3-fbd9fa10e821 tempest-VolumesActionsTest-1426728303 None] Attaching volume 50e9c167-d44f-412e-b627-e6aa8a658f54 to instance 33c017b1-61f9-4c43-95ab-1366cc410429 at mountpoint /dev/vdb on host None.
Apr 24 01:15:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2cb310a5-610e-4733-a4e3-fbd9fa10e821 tempest-VolumesActionsTest-1426728303 None] Attach volume completed successfully.
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2cb310a5-610e-4733-a4e3-fbd9fa10e821 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54" released by "attach_volume" :: held 0.144s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-787f0650-fd18-469f-b709-0f0b9a384086-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-787f0650-fd18-469f-b709-0f0b9a384086-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b9495-1ab9-4e22-9ff2-bd842ed9e83c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:42 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:42 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:43 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d 1G" returned: 0 in 0.940s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:43 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:43 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Terminate volume connection completed successfully.
Apr 24 01:15:43 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.850s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:43 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086
Apr 24 01:15:43 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:44 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.735s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:44 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d is being set with open permissions: ugo+rw
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:44 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:44 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" by "detach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Detaching volume 50e9c167-d44f-412e-b627-e6aa8a658f54 from instance 33c017b1-61f9-4c43-95ab-1366cc410429.
Apr 24 01:15:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Detach volume completed successfully.
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0b75013e-c733-4ce2-9d72-5f840966aecc tempest-VolumesActionsTest-650103721 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:44 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-787f0650-fd18-469f-b709-0f0b9a384086" returned: 0 in 0.605s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-787f0650-fd18-469f-b709-0f0b9a384086" released by "delete_volume" :: held 1.517s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['a2dd81d6-77db-4ddf-94fc-5f7e9eb45c7c', '2a34decd-09aa-4a96-a4c8-dfb0ea0b240f', 'f7baf701-b15d-4f14-b39a-d730c96f047a', '6b4261ae-34d1-45d7-94d3-081b49d3e472'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:44 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:44 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:44 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.497s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f7045b48-e23f-481e-ab2c-d9f32bb668bb tempest-VolumesSnapshotListTestJSON-814426362 None] Create snapshot completed successfully
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3403ea40-50d3-48b5-bf38-d8904331d470 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" by "detach_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3403ea40-50d3-48b5-bf38-d8904331d470 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3403ea40-50d3-48b5-bf38-d8904331d470 tempest-VolumesActionsTest-1426728303 None] Volume detach called, but volume not attached.
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3403ea40-50d3-48b5-bf38-d8904331d470 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:44 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleted volume successfully.
Apr 24 01:15:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e7617bc8-98df-4bdd-9346-6e758a046553 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-787f0650-fd18-469f-b709-0f0b9a384086-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Creating offline snapshot 58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781c3c3-0b22-451a-a90e-cec0f8de6b1b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:45 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:45 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-quobyte-50e9c167-d44f-412e-b627-e6aa8a658f54" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "cinder-quobyte-50e9c167-d44f-412e-b627-e6aa8a658f54" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f319f3e4-3ebf-44cc-8c9c-045ab8b180b9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (9a650c02-5210-4a9f-bcce-212fe5fe065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c1ae38-6d53-449c-80ff-563ccf0ec67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c1ae38-6d53-449c-80ff-563ccf0ec67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1461483797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1186e972-96ba-432b-a31a-ff03121ab443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:46Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc784b43-4bca-4f11-8b5e-c7c59cd711cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc784b43-4bca-4f11-8b5e-c7c59cd711cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd32ca-5bab-4e20-b4e8-20b083204d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd32ca-5bab-4e20-b4e8-20b083204d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1186e972-96ba-432b-a31a-ff03121ab443', 'volume_name': 'volume-1186e972-96ba-432b-a31a-ff03121ab443', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175f2ce8-5102-4f9d-aaf3-bb4d23d32f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175f2ce8-5102-4f9d-aaf3-bb4d23d32f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:45 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54
Apr 24 01:15:45 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7568f-2d67-4418-8463-7b1adfac034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume 1186e972-96ba-432b-a31a-ff03121ab443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1186e972-96ba-432b-a31a-ff03121ab443', 'volume_size': 1}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:45 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.670s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:45 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 1G
Apr 24 01:15:45 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:46 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:46 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54
Apr 24 01:15:46 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:46 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 1G" returned: 0 in 0.745s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:46 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5
Apr 24 01:15:46 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:46 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-50e9c167-d44f-412e-b627-e6aa8a658f54" returned: 0 in 0.554s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "cinder-quobyte-50e9c167-d44f-412e-b627-e6aa8a658f54" released by "delete_volume" :: held 1.160s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Created reservations ['456bfcb4-0a5e-4b7a-bfa0-8c99acba849d', 'c9d8a9e0-801b-412b-909d-2c4397d01e55', 'a24b5fce-c3ae-4f85-8852-631f1461dae9', '204d5993-c902-46d9-8851-5aa944416ef2'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:47 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:15:47 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:47 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" returned: 0 in 0.584s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:47 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 is being set with open permissions: ugo+rw
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:47 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5
Apr 24 01:15:47 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:47 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.523s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:15:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Deleted volume successfully.
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-c6efb8eb-ebdc-41d8-b8e1-6b963b22dffc tempest-VolumesActionsTest-1426728303 None] Lock "cinder-50e9c167-d44f-412e-b627-e6aa8a658f54-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:47 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" returned: 0 in 0.494s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1461483797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1186e972-96ba-432b-a31a-ff03121ab443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:46Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating volume 1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:47 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:15:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:47 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 1073741824
Apr 24 01:15:47 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bb582598-5116-4c85-82e1-1aecb52c49fd tempest-VolumesSnapshotListTestJSON-814426362 None] Create snapshot completed successfully
Apr 24 01:15:48 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 1073741824" returned: 0 in 0.780s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:48 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:15:48 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:49 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.679s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7568f-2d67-4418-8463-7b1adfac034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1186e972-96ba-432b-a31a-ff03121ab443', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ea127-5fb1-4274-b331-219dd4e3961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:49 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume volume-1186e972-96ba-432b-a31a-ff03121ab443 (1186e972-96ba-432b-a31a-ff03121ab443): created successfully
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ea127-5fb1-4274-b331-219dd4e3961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (9a650c02-5210-4a9f-bcce-212fe5fe065f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:49 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d2f2ad28-79f2-490d-afff-d9ac1413d112 tempest-VolumesSnapshotTestJSON-1613464410 None] Created volume successfully.
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Deleting offline snapshot 58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] snapshot_file for this snap is: volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f35279-ee4e-4542-a3af-5cde6917739a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:49 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5
Apr 24 01:15:49 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating offline snapshot 8b5c0589-7f2c-43c5-8c28-778847b236c6 of volume 1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34a2d7-dc1d-482c-83a2-86565ae706d9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:50 devstack sudo[88878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:15:50 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:50 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" returned: 0 in 0.841s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecd6ca-c544-4997-a068-c049f533bbc4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:50 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:50 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:50 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.617s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:50 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 1G
Apr 24 01:15:50 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:50 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.632s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:51 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5
Apr 24 01:15:51 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:51 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 1G" returned: 0 in 0.778s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1186e972-96ba-432b-a31a-ff03121ab443 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:51 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1186e972-96ba-432b-a31a-ff03121ab443 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:15:51 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:51 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" returned: 0 in 0.849s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:51 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5
Apr 24 01:15:51 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:52 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1186e972-96ba-432b-a31a-ff03121ab443 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.603s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:52 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 is being set with open permissions: ugo+rw
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:52 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:15:52 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:52 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" returned: 0 in 0.570s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5" released by "_delete_snapshot" :: held 3.035s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" released by "delete_snapshot" :: held 3.074s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Created reservations ['04358c36-4f20-413c-9c3e-7d79b8895481', '421a0c97-1614-4e2e-aff9-f8a75f67e7c1', 'ea4c92a2-11f3-40aa-a8ee-6dfe87f5a6b1', 'e7092cd2-e92e-4fc9-b46f-9d4e8e967e0c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Delete snapshot completed successfully.
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7e4bcdda-da05-4a18-aaef-95a80bbca23d tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-58bcd5ab-fb8b-453f-9ff1-977dde9ed4f5-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:52 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.526s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:52 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info
Apr 24 01:15:52 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:53 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info" returned: 0 in 0.507s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:53 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info is being set with open permissions: ugo+rw
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:53 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info
Apr 24 01:15:53 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-4bef6d57-398e-4db2-bfd3-f4d01136ad1d-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-4bef6d57-398e-4db2-bfd3-f4d01136ad1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-4bef6d57-398e-4db2-bfd3-f4d01136ad1d" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-4bef6d57-398e-4db2-bfd3-f4d01136ad1d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Deleting offline snapshot 4bef6d57-398e-4db2-bfd3-f4d01136ad1d of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] snapshot_file for this snap is: volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2253d-65c4-4303-b1cc-f6e1185fbc2c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:53 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:53 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:53 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.info" returned: 0 in 0.550s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.679s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-06a89db6-d11d-4844-862d-5f12da869ed4 tempest-VolumesSnapshotTestJSON-1613464410 None] Create snapshot completed successfully
Apr 24 01:15:54 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.599s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426089b-7f44-4c87-8eec-141e531d3d0c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:54 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:54 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:54 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 0.681s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:54 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:54 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (1bf68fe9-57af-4dee-a5bd-877fefd9ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600662d1-a083-4137-b018-b9fb7ca2e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600662d1-a083-4137-b018-b9fb7ca2e163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606077325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846affbc-baf4-417f-a705-e46e1bd8fa8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142a10974fb54f3a91ebe17912b8a0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b5c0589-7f2c-43c5-8c28-778847b236c6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:55Z,use_quota=True,user_id='43a574f4646748c3a2dfb0cc1af0001e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cce88f-d2be-4a55-afe1-f66421aa0777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cce88f-d2be-4a55-afe1-f66421aa0777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9264d7-a9cf-4e6e-9ca1-40b6a8f2fff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9264d7-a9cf-4e6e-9ca1-40b6a8f2fff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '846affbc-baf4-417f-a705-e46e1bd8fa8d', 'volume_name': 'volume-846affbc-baf4-417f-a705-e46e1bd8fa8d', 'volume_size': 1, 'snapshot_id': '8b5c0589-7f2c-43c5-8c28-778847b236c6'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446eeb09-6333-4db5-b783-b587fefb7221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446eeb09-6333-4db5-b783-b587fefb7221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6468e997-c470-4b24-8a81-79c586ef411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume 846affbc-baf4-417f-a705-e46e1bd8fa8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-846affbc-baf4-417f-a705-e46e1bd8fa8d', 'volume_size': 1, 'snapshot_id': '8b5c0589-7f2c-43c5-8c28-778847b236c6'}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6-846affbc-baf4-417f-a705-e46e1bd8fa8d" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6-846affbc-baf4-417f-a705-e46e1bd8fa8d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating volume 846affbc-baf4-417f-a705-e46e1bd8fa8d from snapshot 8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] snapshot: 8b5c0589-7f2c-43c5-8c28-778847b236c6, volume: 846affbc-baf4-417f-a705-e46e1bd8fa8d,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed626ea-8588-4aec-ba34-d15859888b5c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:55 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:15:55 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:55 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.735s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:55 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d
Apr 24 01:15:55 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:55 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.677s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1186e972-96ba-432b-a31a-ff03121ab443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:15:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (323ecfaa-b982-4a02-9ba9-d5311070fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eac6bba-2357-4225-a323-ceaf3979d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fda6e-2196-4f8a-8ac2-ac9c5ce1a0c8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eac6bba-2357-4225-a323-ceaf3979d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719436499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fc6b18-7045-461a-8dfa-90c110825912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:56Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b4e7f3-f524-4dc4-b222-db401b48ccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b4e7f3-f524-4dc4-b222-db401b48ccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb3b071-14be-4874-aea0-31d370bd1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb3b071-14be-4874-aea0-31d370bd1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fc6b18-7045-461a-8dfa-90c110825912', 'volume_name': 'volume-68fc6b18-7045-461a-8dfa-90c110825912', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd864cc-eb21-417a-8276-a19610126bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd864cc-eb21-417a-8276-a19610126bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71036ae9-1faa-4383-b724-c85f11a3808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:15:56 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Volume 68fc6b18-7045-461a-8dfa-90c110825912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fc6b18-7045-461a-8dfa-90c110825912', 'volume_size': 1}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:15:56 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:15:56 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:56 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.4bef6d57-398e-4db2-bfd3-f4d01136ad1d" returned: 0 in 0.588s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-4bef6d57-398e-4db2-bfd3-f4d01136ad1d" released by "_delete_snapshot" :: held 2.696s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" released by "delete_snapshot" :: held 2.721s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Created reservations ['aa9e6337-7af5-4afe-a848-ef02fb579985', 'f15476e3-5b7d-4726-81eb-d4c77c402ba2', 'eb9b767e-11ce-409b-8715-6cc0cbcf5680', 'c8e0d626-7645-4c03-b26f-88c55bb9853d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:15:56 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Delete snapshot completed successfully.
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e86f5091-8258-4306-beb8-55bc241790c6 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-4bef6d57-398e-4db2-bfd3-f4d01136ad1d-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:15:56 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.644s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:56 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d
Apr 24 01:15:56 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Deleting offline snapshot 6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 of volume d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] snapshot_file for this snap is: volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97ceac-f4d5-43ac-8619-6d91630ac659]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:56 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:56 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:57 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 0.636s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46911a9-b1d6-46fe-a754-51d584d8420f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:15:57 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0dbdc-9ead-4236-a1c2-2ef3a4f388cd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:15:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:57 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f
Apr 24 01:15:57 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:15:59 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Apr 24 01:15:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f" returned: 0 in 1.703s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:15:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:15:59 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:15:59 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:00 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 1.578s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:00 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12
Apr 24 01:16:00 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:01 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f.6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" returned: 0 in 1.170s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12" released by "_delete_snapshot" :: held 5.299s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" released by "delete_snapshot" :: held 5.333s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Created reservations ['2b8fc41c-e93d-4e67-ab9d-69e8dc47018b', 'f551d0f9-893f-4880-b053-873da254b9b0', 'eb806dbb-6e77-420f-b832-cba72fc884fc', '4ce5b23b-c6aa-4bb3-b0b6-0a4b40fc3904'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Delete snapshot completed successfully.
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3c0de876-3e44-4ecb-8eab-20a889c3037e tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-6d69b3c3-b0b3-4e47-adaf-9d934c6a6a12-delete_snapshot" released by "delete_snapshot" :: held 5.604s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:02 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d" returned: 0 in 5.710s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8310f4-e55a-4f79-be78-cf7e84547f53]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:02 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:16:02 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:03 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.751s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:16:03 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Converted 1024.00 MB image at 179.28 MB/s
Apr 24 01:16:03 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d is being set with open permissions: ugo+rw
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:03 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d
Apr 24 01:16:03 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-d46911a9-b1d6-46fe-a754-51d584d8420f-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-d46911a9-b1d6-46fe-a754-51d584d8420f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e1722c-f277-46f2-be8b-cdac108889e3]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:03 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f
Apr 24 01:16:03 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:03 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d" returned: 0 in 0.596s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" released by "_copy_volume_from_snapshot" :: held 8.534s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6-846affbc-baf4-417f-a705-e46e1bd8fa8d" released by "_create_volume_from_snapshot" :: held 8.575s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.599s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.703s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719436499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fc6b18-7045-461a-8dfa-90c110825912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:56Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Creating volume 68fc6b18-7045-461a-8dfa-90c110825912 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:03 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:03 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 1073741824
Apr 24 01:16:03 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6468e997-c470-4b24-8a81-79c586ef411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846affbc-baf4-417f-a705-e46e1bd8fa8d', 'volume_size': 1, 'snapshot_id': '8b5c0589-7f2c-43c5-8c28-778847b236c6'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54d066-557e-45c2-a0db-a5493e3a0ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:03 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Volume volume-846affbc-baf4-417f-a705-e46e1bd8fa8d (846affbc-baf4-417f-a705-e46e1bd8fa8d): created successfully
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54d066-557e-45c2-a0db-a5493e3a0ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Flow 'volume_create_manager' (1bf68fe9-57af-4dee-a5bd-877fefd9ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:03 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ad24930a-9a21-4e73-931a-92ba788cf0e9 tempest-VolumesSnapshotTestJSON-1613464410 None] Created volume successfully.
Apr 24 01:16:04 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f" returned: 0 in 0.705s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:04 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f
Apr 24 01:16:04 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:04 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 1073741824" returned: 0 in 0.821s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:04 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912
Apr 24 01:16:04 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:04 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d46911a9-b1d6-46fe-a754-51d584d8420f" returned: 0 in 0.598s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-quobyte-d46911a9-b1d6-46fe-a754-51d584d8420f" released by "delete_volume" :: held 1.376s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Created reservations ['10378f0f-b318-474b-a3f7-9a42eab9c821', '9bb6435c-4812-4e9e-9bf2-c27af8b16574', '12013a8d-9eae-4a64-af0a-7fa143b09653', 'ca12d415-27cd-4503-8caf-873271a751cc'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:04 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:04 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-846affbc-baf4-417f-a705-e46e1bd8fa8d-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-846affbc-baf4-417f-a705-e46e1bd8fa8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:05 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912" returned: 0 in 0.616s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71036ae9-1faa-4383-b724-c85f11a3808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fc6b18-7045-461a-8dfa-90c110825912', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b890be18-2d50-470a-88a2-4cf12f00b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:05 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Volume volume-68fc6b18-7045-461a-8dfa-90c110825912 (68fc6b18-7045-461a-8dfa-90c110825912): created successfully
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b890be18-2d50-470a-88a2-4cf12f00b645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (323ecfaa-b982-4a02-9ba9-d5311070fd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" acquired by "delete_volume" :: waited 0.034s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3fe7ad4e-4d6e-4d08-bc4d-8a4dd4b0ebf0 tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e175e-9b8b-4d88-bcf0-bccb3b84ba5f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:05 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d
Apr 24 01:16:05 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:05 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.685s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Deleted volume successfully.
Apr 24 01:16:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f9961534-dbe2-4daf-9e3a-dba4d9046454 tempest-VolumesSnapshotListTestJSON-814426362 None] Lock "cinder-d46911a9-b1d6-46fe-a754-51d584d8420f-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-68fc6b18-7045-461a-8dfa-90c110825912-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "cinder-68fc6b18-7045-461a-8dfa-90c110825912-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:06 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d" returned: 0 in 0.736s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-quobyte-68fc6b18-7045-461a-8dfa-90c110825912" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:06 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d
Apr 24 01:16:06 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-68fc6b18-7045-461a-8dfa-90c110825912" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[825abf7d-74d6-4bb3-9d4a-fc6309ff09bd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:06 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912
Apr 24 01:16:06 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:06 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-846affbc-baf4-417f-a705-e46e1bd8fa8d" returned: 0 in 0.658s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-846affbc-baf4-417f-a705-e46e1bd8fa8d" released by "delete_volume" :: held 1.448s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['78aeb0cb-2461-4894-94a2-6478b1caff8c', 'b8db294d-5aa5-4d6e-8744-b9a5f3bc2656', '4d888b91-c991-4325-81f4-e21e7f066ce6', '8f9bdea0-98fb-4a18-b4b9-fd741b033ae3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:06 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:06 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912
Apr 24 01:16:06 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:07 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:07 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:07 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-68fc6b18-7045-461a-8dfa-90c110825912" returned: 0 in 0.594s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-68fc6b18-7045-461a-8dfa-90c110825912" released by "delete_volume" :: held 1.338s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-8b5c0589-7f2c-43c5-8c28-778847b236c6-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Created reservations ['1e45e068-3fba-4343-b4d6-045aaacf5ba5', '72a0070f-e7ae-46aa-a4f2-f4fb9d8a9f3b', 'd3e62a68-9d98-4349-b702-50f223a7a1f7', 'feda8517-be32-4ed8-aad8-27a1d718275f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:07 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.650s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Deleted volume successfully.
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-8b5c0589-7f2c-43c5-8c28-778847b236c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ed8a3243-44d3-4cd7-8aa5-cabfb83698cc tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-846affbc-baf4-417f-a705-e46e1bd8fa8d-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" acquired by "delete_snapshot" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:07 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:07 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleting offline snapshot 8b5c0589-7f2c-43c5-8c28-778847b236c6 of volume 1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] snapshot_file for this snap is: volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f88a11-403f-49b7-9ff7-e3c184a20708]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:07 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:16:07 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:08 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.587s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Deleted volume successfully.
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5dbd867a-8d9b-4c27-9442-26a10c6a5dde tempest-VolumesActionsTest-650103721 None] Lock "cinder-68fc6b18-7045-461a-8dfa-90c110825912-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:08 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.671s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1186e972-96ba-432b-a31a-ff03121ab443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b646b3-5a60-4fff-804a-0e70baacd516]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:08 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:16:08 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (7360e840-df58-459b-9daa-b00bbf9e42e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1669219-fbf1-41fa-969e-0dd86673c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1669219-fbf1-41fa-969e-0dd86673c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132833589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a50dfb3-a08c-4194-aed9-c9123fb77856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:09Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c68689-74e3-48c7-8d07-9693e28559b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c68689-74e3-48c7-8d07-9693e28559b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840b4aa6-8623-430b-ab00-206964f11b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840b4aa6-8623-430b-ab00-206964f11b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a50dfb3-a08c-4194-aed9-c9123fb77856', 'volume_name': 'volume-8a50dfb3-a08c-4194-aed9-c9123fb77856', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0104c4f-d392-4b3e-b38b-b523f6bf5b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0104c4f-d392-4b3e-b38b-b523f6bf5b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b9060-1eba-4013-961b-30e47a90354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Volume 8a50dfb3-a08c-4194-aed9-c9123fb77856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a50dfb3-a08c-4194-aed9-c9123fb77856', 'volume_size': 1}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132833589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a50dfb3-a08c-4194-aed9-c9123fb77856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:09Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Creating volume 8a50dfb3-a08c-4194-aed9-c9123fb77856 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:08 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:08 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 1073741824
Apr 24 01:16:08 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:09 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.620s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:09 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:16:09 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:09 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 1073741824" returned: 0 in 0.698s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:09 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856
Apr 24 01:16:09 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:09 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.684s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:09 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6
Apr 24 01:16:09 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:10 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b9060-1eba-4013-961b-30e47a90354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a50dfb3-a08c-4194-aed9-c9123fb77856', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ffa0e0-1905-46d3-ab12-9ee533c41c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Volume volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 (8a50dfb3-a08c-4194-aed9-c9123fb77856): created successfully
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ffa0e0-1905-46d3-ab12-9ee533c41c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (7360e840-df58-459b-9daa-b00bbf9e42e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d3d33cb0-8fee-42d9-a1c7-7cda377bcbdc tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:16:10 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443.8b5c0589-7f2c-43c5-8c28-778847b236c6" returned: 0 in 0.489s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-8b5c0589-7f2c-43c5-8c28-778847b236c6" released by "_delete_snapshot" :: held 2.577s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" released by "delete_snapshot" :: held 2.630s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['d2915bd2-67da-4dcb-bbef-1773039fffc8', 'f45c7a84-a820-4075-a853-93d3dbe50434', '1ef03eab-a37c-46c6-a6b5-b373faacf852', '7492c6ae-08ef-4ba5-8d77-8ca8ca90fda3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Delete snapshot completed successfully.
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-663e5533-0bb0-43fd-91ae-968986f22437 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-8b5c0589-7f2c-43c5-8c28-778847b236c6-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-1186e972-96ba-432b-a31a-ff03121ab443-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-1186e972-96ba-432b-a31a-ff03121ab443-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476192d-8090-456c-a3b2-bd2baabe2ff1]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-8a50dfb3-a08c-4194-aed9-c9123fb77856-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "cinder-8a50dfb3-a08c-4194-aed9-c9123fb77856-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:11 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:16:11 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-quobyte-8a50dfb3-a08c-4194-aed9-c9123fb77856" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-8a50dfb3-a08c-4194-aed9-c9123fb77856" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c924cb-9aa5-467e-aecb-03f8d5bf3b57]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:11 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856
Apr 24 01:16:11 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:11 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.659s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:11 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443
Apr 24 01:16:11 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:11 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856" returned: 0 in 0.593s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:11 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856
Apr 24 01:16:11 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:12 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1186e972-96ba-432b-a31a-ff03121ab443" returned: 0 in 0.555s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-1186e972-96ba-432b-a31a-ff03121ab443" released by "delete_volume" :: held 1.279s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['012d1a17-925c-4c67-baf4-295cdb0a7567', '442e68ee-c48a-4c3f-9f98-35caa8af0cd8', '630be4fc-b2ac-48a7-a072-ec9b401c2be7', '6e90695d-51b6-4871-a6a9-67a6b1ec0170'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:12 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8a50dfb3-a08c-4194-aed9-c9123fb77856" returned: 0 in 0.556s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-8a50dfb3-a08c-4194-aed9-c9123fb77856" released by "delete_volume" :: held 1.195s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=125,cinder:UPDATE=120,cinder:INSERT=33,cinder:DELETE=11 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=139,cinder:DELETE=11,cinder:SELECT=113,cinder:INSERT=35 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:12 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:12 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Created reservations ['e56f9b46-85fa-4e60-8f30-d4254b2ceb1f', 'c5b8bece-dafc-4d99-af03-f580fc762aa7', 'f44c6100-a5cc-47ed-bd37-46438d4de1a5', '5fa7c357-ccd1-4199-ab66-8790b8b18a55'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:12 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:12 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:12 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.501s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:12 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Deleted volume successfully.
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dbba7965-ff0d-44da-8878-6f7c374cd6dd tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-1186e972-96ba-432b-a31a-ff03121ab443-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:13 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.569s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Deleted volume successfully.
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ada6d3f3-0e35-4ee8-b60f-36d166c44180 tempest-VolumesActionsTest-650103721 None] Lock "cinder-8a50dfb3-a08c-4194-aed9-c9123fb77856-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-e2973c9c-8c62-4ebf-ad95-8bd92c543a13-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-e2973c9c-8c62-4ebf-ad95-8bd92c543a13-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1185da5-23c7-45c1-b79c-51271fbdfd0f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:13 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13
Apr 24 01:16:13 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (6f464699-5682-4257-b827-0bdaae30eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c1b17a-f751-4a10-a931-0a7470a0cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c1b17a-f751-4a10-a931-0a7470a0cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401925001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b76be-587e-462e-a542-28d6c8209f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:14Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17532436-27a0-478a-9d45-8cbf1270890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17532436-27a0-478a-9d45-8cbf1270890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee52fa-38ec-4bb9-bf56-decb8f83c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee52fa-38ec-4bb9-bf56-decb8f83c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693b76be-587e-462e-a542-28d6c8209f28', 'volume_name': 'volume-693b76be-587e-462e-a542-28d6c8209f28', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611d4320-0c20-41e7-8b2c-561632f682a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611d4320-0c20-41e7-8b2c-561632f682a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30360adb-47f9-41b7-8a78-d53ec9ff76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Volume 693b76be-587e-462e-a542-28d6c8209f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693b76be-587e-462e-a542-28d6c8209f28', 'volume_size': 1}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401925001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b76be-587e-462e-a542-28d6c8209f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:14Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Creating volume 693b76be-587e-462e-a542-28d6c8209f28 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:13 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 1073741824
Apr 24 01:16:13 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:14 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" returned: 0 in 0.616s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:14 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13
Apr 24 01:16:14 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:14 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 1073741824" returned: 0 in 0.692s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:14 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28
Apr 24 01:16:14 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:14 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" returned: 0 in 0.575s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-quobyte-e2973c9c-8c62-4ebf-ad95-8bd92c543a13" released by "delete_volume" :: held 1.259s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Created reservations ['f8e9d256-87bb-4f5e-b067-cb8a65aa1e2a', '31477b22-68d3-4ab2-8d41-11b01e7070e4', 'baa6f3b1-3291-424f-9fc7-a75064467778', 'cba56c05-789f-4e7b-a0a5-a9f45c29ff90'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:14 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:14 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:15 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28" returned: 0 in 0.553s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30360adb-47f9-41b7-8a78-d53ec9ff76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693b76be-587e-462e-a542-28d6c8209f28', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4182c78-2841-4a37-97ac-87009a60f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Volume volume-693b76be-587e-462e-a542-28d6c8209f28 (693b76be-587e-462e-a542-28d6c8209f28): created successfully
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4182c78-2841-4a37-97ac-87009a60f67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (6f464699-5682-4257-b827-0bdaae30eb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9d32fb73-14ac-4e6a-9e40-879709dcabc5 tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:16:15 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.499s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Deleted volume successfully.
Apr 24 01:16:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0d8e8162-496c-4844-88f7-e5807b909fb1 tempest-VolumesSnapshotTestJSON-1613464410 None] Lock "cinder-e2973c9c-8c62-4ebf-ad95-8bd92c543a13-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-693b76be-587e-462e-a542-28d6c8209f28-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "cinder-693b76be-587e-462e-a542-28d6c8209f28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-quobyte-693b76be-587e-462e-a542-28d6c8209f28" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-693b76be-587e-462e-a542-28d6c8209f28" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f7e43-8f2e-4ab4-924e-81dfdc87c768]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:16 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28
Apr 24 01:16:16 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:16 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28" returned: 0 in 0.699s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:16 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28
Apr 24 01:16:16 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:17 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-693b76be-587e-462e-a542-28d6c8209f28" returned: 0 in 0.600s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-693b76be-587e-462e-a542-28d6c8209f28" released by "delete_volume" :: held 1.345s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Created reservations ['a7049dde-69ac-48b9-8117-5f5520a89397', '5b68f24f-1e11-48e9-a578-1ee4b8b82bf0', '6945aa5f-b915-4eaf-a7b5-b79f698cb8bf', '7054564b-15a4-43e0-813e-387878f54935'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:17 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:17 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:18 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.571s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Deleted volume successfully.
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-43f84dfb-e38f-4df9-a22a-36c523979bf1 tempest-VolumesActionsTest-650103721 None] Lock "cinder-693b76be-587e-462e-a542-28d6c8209f28-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (58be6d1a-74e0-487d-ba6b-9c972398fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1044a5c3-a33e-4c21-8bf7-b213d1424d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1044a5c3-a33e-4c21-8bf7-b213d1424d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-893393341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d8e7d3-08d8-4370-8a66-5cda2d64c974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:19Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5677e1e6-9a0e-49c9-84c5-da08cce04403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5677e1e6-9a0e-49c9-84c5-da08cce04403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bebf8d-a94f-4f5e-a250-631b7c7380a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bebf8d-a94f-4f5e-a250-631b7c7380a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d8e7d3-08d8-4370-8a66-5cda2d64c974', 'volume_name': 'volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e429d3b-0786-49f1-833b-b7467f4f05b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e429d3b-0786-49f1-833b-b7467f4f05b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfea4f0-6dbf-405b-b507-610ea03ceccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:18 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Volume 67d8e7d3-08d8-4370-8a66-5cda2d64c974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974', 'volume_size': 1}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-893393341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d8e7d3-08d8-4370-8a66-5cda2d64c974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:19Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Creating volume 67d8e7d3-08d8-4370-8a66-5cda2d64c974 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:19 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:19 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 1073741824
Apr 24 01:16:19 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:19 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:19 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:19 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 1073741824" returned: 0 in 0.783s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:19 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974
Apr 24 01:16:19 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:19 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.592s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:20 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfea4f0-6dbf-405b-b507-610ea03ceccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400df01b-c246-42d2-b39b-4dc7d19f4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Volume volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 (67d8e7d3-08d8-4370-8a66-5cda2d64c974): created successfully
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400df01b-c246-42d2-b39b-4dc7d19f4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (58be6d1a-74e0-487d-ba6b-9c972398fa58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:20 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-47e024e4-c343-4dc2-9c41-4d5914edd639 tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-67d8e7d3-08d8-4370-8a66-5cda2d64c974-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "cinder-67d8e7d3-08d8-4370-8a66-5cda2d64c974-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Acquiring lock "cinder-quobyte-67d8e7d3-08d8-4370-8a66-5cda2d64c974" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-67d8e7d3-08d8-4370-8a66-5cda2d64c974" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[92519cd6-16de-4c66-87d7-75b07e0b90b5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:21 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974
Apr 24 01:16:21 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:21 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974" returned: 0 in 0.647s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:21 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974
Apr 24 01:16:22 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:22 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67d8e7d3-08d8-4370-8a66-5cda2d64c974" returned: 0 in 0.639s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "cinder-quobyte-67d8e7d3-08d8-4370-8a66-5cda2d64c974" released by "delete_volume" :: held 1.340s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Flow 'volume_create_manager' (9d064077-5ec8-492b-aebd-3a3d7e94610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb1315c-64c9-453c-8a13-7b7d909fc6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Created reservations ['f04582c7-6de9-49dd-a100-d39c1ef4f7f4', 'f8037978-eecd-49f7-8c63-ea961892eed0', '29a4308b-141a-4258-976d-32af97c71dbc', 'c6c39f74-b155-42dd-aa6a-150ea7d043c7'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb1315c-64c9-453c-8a13-7b7d909fc6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1379603185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46640e9c-9630-4b1a-87c6-f2a3254bd186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecd1267d4324e36b72313c9229ec375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:23Z,use_quota=True,user_id='8aa4fb30b62943e39952ec6edbaccf81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595c967e-97b4-412f-bb36-ba84dfe567da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595c967e-97b4-412f-bb36-ba84dfe567da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb23f0fc-903a-4121-88e7-ebcb8254efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb23f0fc-903a-4121-88e7-ebcb8254efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46640e9c-9630-4b1a-87c6-f2a3254bd186', 'volume_name': 'volume-46640e9c-9630-4b1a-87c6-f2a3254bd186', 'volume_size': 2}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7599ef0e-630a-438b-8ea2-696e2728d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7599ef0e-630a-438b-8ea2-696e2728d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4959ffd9-d41e-4159-92f4-c6c2f0d6d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:22 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Volume 46640e9c-9630-4b1a-87c6-f2a3254bd186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46640e9c-9630-4b1a-87c6-f2a3254bd186', 'volume_size': 2}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1379603185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46640e9c-9630-4b1a-87c6-f2a3254bd186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecd1267d4324e36b72313c9229ec375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:23Z,use_quota=True,user_id='8aa4fb30b62943e39952ec6edbaccf81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Creating volume 46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:22 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 2147483648 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:22 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 2147483648
Apr 24 01:16:22 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:22 devstack sudo[89138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:22 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:23 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Deleted volume successfully.
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9f03eca-9a6c-40c7-85a9-c59b6fca06d5 tempest-VolumesActionsTest-650103721 None] Lock "cinder-67d8e7d3-08d8-4370-8a66-5cda2d64c974-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:23 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 2147483648" returned: 0 in 0.832s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:23 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186
Apr 24 01:16:23 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:23 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (c76a57da-583d-4d11-87ff-258f6eaca56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b67f497-9b67-4eb2-b936-4132b0d0d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b67f497-9b67-4eb2-b936-4132b0d0d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563608793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3778b78-4f37-45d1-9aa9-aec2c1a10df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:24Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2b4c94-da2f-4e92-b579-11b17aea5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2b4c94-da2f-4e92-b579-11b17aea5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403cd464-0bd9-44c3-b254-cf99746c425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403cd464-0bd9-44c3-b254-cf99746c425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3778b78-4f37-45d1-9aa9-aec2c1a10df6', 'volume_name': 'volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc213f2-b87e-4cfc-b9a5-86a609d6cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc213f2-b87e-4cfc-b9a5-86a609d6cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46862067-ccc2-4726-86e6-e9934a465362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Volume f3778b78-4f37-45d1-9aa9-aec2c1a10df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6', 'volume_size': 1}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:24 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563608793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3778b78-4f37-45d1-9aa9-aec2c1a10df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876509a641bc48109def25134b788996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:24Z,use_quota=True,user_id='20ac453adab94b92bc614fd92bd427ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Creating volume f3778b78-4f37-45d1-9aa9-aec2c1a10df6 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:24 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4959ffd9-d41e-4159-92f4-c6c2f0d6d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46640e9c-9630-4b1a-87c6-f2a3254bd186', 'volume_size': 2}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 1073741824
Apr 24 01:16:24 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81635a68-fc24-4e15-b47e-5747cf6f29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:24 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Volume volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 (46640e9c-9630-4b1a-87c6-f2a3254bd186): created successfully
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81635a68-fc24-4e15-b47e-5747cf6f29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Flow 'volume_create_manager' (9d064077-5ec8-492b-aebd-3a3d7e94610c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-413da1d6-daaf-4d64-b9b4-412f621cc534 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Created volume successfully.
Apr 24 01:16:24 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 1073741824" returned: 0 in 0.629s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:24 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6
Apr 24 01:16:24 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:25 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" returned: 0 in 0.479s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.358s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46862067-ccc2-4726-86e6-e9934a465362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ba1aa1-66e1-47ad-8469-1708468f2438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Volume volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 (f3778b78-4f37-45d1-9aa9-aec2c1a10df6): created successfully
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ba1aa1-66e1-47ad-8469-1708468f2438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Flow 'volume_create_manager' (c76a57da-583d-4d11-87ff-258f6eaca56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Creating offline snapshot e064852d-ad45-44ec-abee-f380969d4beb of volume 46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:16:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bfdf8d53-2ae9-4146-9d0d-f31cd218940f tempest-VolumesActionsTest-1426728303 None] Created volume successfully.
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf989a0-e36f-4188-bb47-6b62794fe639]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:25 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186
Apr 24 01:16:25 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:25 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186" returned: 0 in 0.502s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb 2G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:25 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb 2G
Apr 24 01:16:25 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:26 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb 2G" returned: 0 in 0.688s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:26 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb
Apr 24 01:16:26 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-f3778b78-4f37-45d1-9aa9-aec2c1a10df6-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-f3778b78-4f37-45d1-9aa9-aec2c1a10df6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "cinder-quobyte-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-quobyte-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16c1cb-d0d5-4315-bbd2-8d5f63240108]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:26 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6
Apr 24 01:16:26 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:27 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:27 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb is being set with open permissions: ugo+rw
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:27 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb
Apr 24 01:16:27 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:27 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" returned: 0 in 0.629s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:27 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6
Apr 24 01:16:27 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:27 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb" returned: 0 in 0.544s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:27 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info
Apr 24 01:16:27 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:28 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" returned: 0 in 0.487s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-quobyte-f3778b78-4f37-45d1-9aa9-aec2c1a10df6" released by "delete_volume" :: held 1.162s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Created reservations ['1c1f6ae3-ea9d-4116-97e6-51f5db0af62d', '95a409e3-244b-4259-82f2-16d381357e98', '0b3c651c-4189-4d60-88df-e0f7f70c4dd5', 'f1b5d3fe-06f8-4158-a9dd-b39f6aed02b4'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:28 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:28 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:28 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info" returned: 0 in 0.602s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:28 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info is being set with open permissions: ugo+rw
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:28 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info
Apr 24 01:16:28 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:28 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Deleted volume successfully.
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22c7d067-73f3-49c4-9185-23b1d9deb0e9 tempest-VolumesActionsTest-1426728303 None] Lock "cinder-f3778b78-4f37-45d1-9aa9-aec2c1a10df6-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:28 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.info" returned: 0 in 0.496s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-16435aef-4176-4abc-ae81-a9248cac2378 tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Create snapshot completed successfully
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "cinder-e064852d-ad45-44ec-abee-f380969d4beb-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-e064852d-ad45-44ec-abee-f380969d4beb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "cinder-quobyte-e064852d-ad45-44ec-abee-f380969d4beb" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-e064852d-ad45-44ec-abee-f380969d4beb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Deleting offline snapshot e064852d-ad45-44ec-abee-f380969d4beb of volume 46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] snapshot_file for this snap is: volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4670cb-78ed-47e7-96ff-fa8b531029d7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:29 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb
Apr 24 01:16:29 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:30 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb" returned: 0 in 0.651s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46640e9c-9630-4b1a-87c6-f2a3254bd186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca319a-a80c-4334-873b-750f9a52b355]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:30 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186
Apr 24 01:16:30 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:30 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186" returned: 0 in 0.660s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:30 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb
Apr 24 01:16:30 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:31 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb" returned: 0 in 0.659s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:31 devstack sudo[89207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb
Apr 24 01:16:31 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:31 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186.e064852d-ad45-44ec-abee-f380969d4beb" returned: 0 in 0.564s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-e064852d-ad45-44ec-abee-f380969d4beb" released by "_delete_snapshot" :: held 2.654s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" released by "delete_snapshot" :: held 2.684s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Created reservations ['ec3bd8ee-3ea1-4016-8d21-0c4c30328b8d', '1831d710-e5b3-417b-b6da-dfd08acdc376', '8a43be7f-29b2-4be5-91f7-3e7072a398c1', '4f4b8624-54b6-4374-a626-070b7f80a35c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Delete snapshot completed successfully.
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-739b8fe3-9e24-44e6-bfc5-7beb2178b2dd tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-e064852d-ad45-44ec-abee-f380969d4beb-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "cinder-46640e9c-9630-4b1a-87c6-f2a3254bd186-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-46640e9c-9630-4b1a-87c6-f2a3254bd186-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26729d2-a20b-4244-ba4a-d4f7e7f7c046]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:32 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186
Apr 24 01:16:32 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:33 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186" returned: 0 in 0.684s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:33 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186
Apr 24 01:16:33 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:33 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-46640e9c-9630-4b1a-87c6-f2a3254bd186" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-quobyte-46640e9c-9630-4b1a-87c6-f2a3254bd186" released by "delete_volume" :: held 1.239s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:33 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Created reservations ['b59132de-d75e-42dc-a643-e06e65263595', '41b480f2-af97-46be-90be-f0ced4ffc9f5', '4583d76f-4fb9-4caf-95c7-04443f55dda6', '9544273c-c32e-4521-8f0d-1c4244bb80ba'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:34 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:34 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:34 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.487s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Deleted volume successfully.
Apr 24 01:16:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0efd858d-5371-4036-9ba8-4c9e3cab085a tempest-VolumesSnapshotNegativeTestJSON-1804186911 None] Lock "cinder-46640e9c-9630-4b1a-87c6-f2a3254bd186-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (e6ba9392-01a0-4f7e-992c-85bef4ab33c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79962c2d-369f-4ee8-8c21-fb0e2fa566e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79962c2d-369f-4ee8-8c21-fb0e2fa566e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734235525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1032e282-41bd-4acd-91d4-d958786a8237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:38Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d676e46-8ce3-4f0e-83db-b4d8af8b6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d676e46-8ce3-4f0e-83db-b4d8af8b6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0e8123-14f1-4d77-a218-d73f7461d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0e8123-14f1-4d77-a218-d73f7461d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1032e282-41bd-4acd-91d4-d958786a8237', 'volume_name': 'volume-1032e282-41bd-4acd-91d4-d958786a8237', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ea0487-9b3a-49b3-b4b7-8dca76814c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ea0487-9b3a-49b3-b4b7-8dca76814c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d64a33b-b443-4331-ad76-dc36b80ff91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:37 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume 1032e282-41bd-4acd-91d4-d958786a8237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1032e282-41bd-4acd-91d4-d958786a8237', 'volume_size': 1}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734235525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1032e282-41bd-4acd-91d4-d958786a8237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:38Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume 1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:37 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:37 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 1073741824
Apr 24 01:16:37 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:38 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 1073741824" returned: 0 in 0.698s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:38 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237
Apr 24 01:16:38 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:39 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237" returned: 0 in 0.524s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d64a33b-b443-4331-ad76-dc36b80ff91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1032e282-41bd-4acd-91d4-d958786a8237', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cadd5f3-91cb-4f19-93f0-e0ae20b77f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:39 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-1032e282-41bd-4acd-91d4-d958786a8237 (1032e282-41bd-4acd-91d4-d958786a8237): created successfully
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cadd5f3-91cb-4f19-93f0-e0ae20b77f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (e6ba9392-01a0-4f7e-992c-85bef4ab33c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-fca3ad40-0ecb-4759-a33f-bf60a9c02989 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating offline snapshot 8225eed6-95c0-45b6-8fa3-3117d29146dd of volume 1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92581d0-7c6e-44c3-b5f7-a350dd3b77f5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:40 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237
Apr 24 01:16:40 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:40 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237" returned: 0 in 0.579s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:40 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd 1G
Apr 24 01:16:40 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (dc921137-ffdb-4648-af08-bc2813c17232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2694c0-4058-4369-8d28-a2ca673c8b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2694c0-4058-4369-8d28-a2ca673c8b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004899777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de39088b-0e78-47ed-9091-4c4f790bfa0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:41Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a4735-f2b3-4db9-95fe-a1e049e0945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a4735-f2b3-4db9-95fe-a1e049e0945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95efddd-9c6d-48d1-9b7e-4fba457d896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95efddd-9c6d-48d1-9b7e-4fba457d896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de39088b-0e78-47ed-9091-4c4f790bfa0e', 'volume_name': 'volume-de39088b-0e78-47ed-9091-4c4f790bfa0e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcbc26a-011a-4665-b694-f9fcc8af3243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcbc26a-011a-4665-b694-f9fcc8af3243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8ab21d-6fd6-4036-8e79-8c0481bf7e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Volume de39088b-0e78-47ed-9091-4c4f790bfa0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de39088b-0e78-47ed-9091-4c4f790bfa0e', 'volume_size': 1}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:41 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd 1G" returned: 0 in 0.678s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1032e282-41bd-4acd-91d4-d958786a8237 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:41 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1032e282-41bd-4acd-91d4-d958786a8237 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd
Apr 24 01:16:41 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:42 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1032e282-41bd-4acd-91d4-d958786a8237 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd" returned: 0 in 0.548s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:42 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd is being set with open permissions: ugo+rw
Apr 24 01:16:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:42 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd
Apr 24 01:16:42 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:42 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd" returned: 0 in 0.465s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:42 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info
Apr 24 01:16:42 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:43 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info" returned: 0 in 0.463s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:43 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info is being set with open permissions: ugo+rw
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:43 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info
Apr 24 01:16:43 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:43 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.info" returned: 0 in 0.448s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.077s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004899777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de39088b-0e78-47ed-9091-4c4f790bfa0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:41Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Creating volume de39088b-0e78-47ed-9091-4c4f790bfa0e {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:43 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:43 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e 1073741824
Apr 24 01:16:43 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-343b4ed5-57d9-4d76-a392-f715bc3a84fa tempest-CreateVolumesFromSnapshotTest-573072334 None] Create snapshot completed successfully
Apr 24 01:16:44 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e 1073741824" returned: 0 in 0.642s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:44 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e
Apr 24 01:16:44 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:44 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e" returned: 0 in 0.494s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8ab21d-6fd6-4036-8e79-8c0481bf7e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de39088b-0e78-47ed-9091-4c4f790bfa0e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf344ebb-13ca-4eea-be49-ab2d8a71b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Volume volume-de39088b-0e78-47ed-9091-4c4f790bfa0e (de39088b-0e78-47ed-9091-4c4f790bfa0e): created successfully
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf344ebb-13ca-4eea-be49-ab2d8a71b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (dc921137-ffdb-4648-af08-bc2813c17232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-137a116d-f2e2-4a6d-b7e2-7758198b1902 tempest-VolumesListAdminTestJSON-2020979854 None] Created volume successfully.
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (a09e6538-1b83-4925-8e46-e80c8b37b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131802e9-fce7-4e56-be28-ad23cf225bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131802e9-fce7-4e56-be28-ad23cf225bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693528104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ac1bff-1962-4e51-9c88-ec79daf39a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e403d5-05a0-4c5f-97db-fb8792c801ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e403d5-05a0-4c5f-97db-fb8792c801ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22e54fa-5ea0-43d7-b0b0-ee946766e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22e54fa-5ea0-43d7-b0b0-ee946766e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ac1bff-1962-4e51-9c88-ec79daf39a6b', 'volume_name': 'volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1c0e91-d657-4822-9c34-f0de55326022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1c0e91-d657-4822-9c34-f0de55326022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3b12c8-ddf1-4428-86af-f6b366417813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume 67ac1bff-1962-4e51-9c88-ec79daf39a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b', 'volume_size': 1}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693528104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ac1bff-1962-4e51-9c88-ec79daf39a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume 67ac1bff-1962-4e51-9c88-ec79daf39a6b {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:44 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:44 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b 1073741824
Apr 24 01:16:44 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (f7b2c7fb-8d33-422e-bb37-b2a59f54f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c79530-fd8f-4e4b-b178-9c309d901667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c79530-fd8f-4e4b-b178-9c309d901667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121011003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f498df63-09e1-4779-875e-be67b6daec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e22395-3f38-451c-8d08-274b99a6ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e22395-3f38-451c-8d08-274b99a6ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92812a38-c937-416a-83a7-b0c93de1a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92812a38-c937-416a-83a7-b0c93de1a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f498df63-09e1-4779-875e-be67b6daec81', 'volume_name': 'volume-f498df63-09e1-4779-875e-be67b6daec81', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f832ef8-820f-4acc-a6dc-677c6156b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f832ef8-820f-4acc-a6dc-677c6156b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a3ef36-8c85-46c2-acfb-667d278f9f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume f498df63-09e1-4779-875e-be67b6daec81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f498df63-09e1-4779-875e-be67b6daec81', 'volume_size': 1}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (bdadd31b-31b7-4e40-b726-0836d10acc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d247a-eda7-41fe-9647-58ffd86e37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d247a-eda7-41fe-9647-58ffd86e37b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614262418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87001548-99bf-4f61-8807-48c4308791f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc39053-a28d-4339-8600-937df470e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc39053-a28d-4339-8600-937df470e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfc232c-83f5-4500-bc15-e78c5efa0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfc232c-83f5-4500-bc15-e78c5efa0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87001548-99bf-4f61-8807-48c4308791f0', 'volume_name': 'volume-87001548-99bf-4f61-8807-48c4308791f0', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf23efdb-9081-49d7-9ff9-bead01191906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf23efdb-9081-49d7-9ff9-bead01191906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7350f315-db95-4b41-999e-002f20b03d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume 87001548-99bf-4f61-8807-48c4308791f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87001548-99bf-4f61-8807-48c4308791f0', 'volume_size': 1}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:45 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b 1073741824" returned: 0 in 0.694s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:45 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b
Apr 24 01:16:45 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (4ab3dd4a-225c-4c90-b21d-b3396b1a46d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6beadd7-97b4-4c8c-9221-87c800b2337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6beadd7-97b4-4c8c-9221-87c800b2337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835357076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92b82fc-9d3a-4fad-b61a-c6477bdc9de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5011d1-0569-4c37-87db-70d8927d375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5011d1-0569-4c37-87db-70d8927d375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c55adc7-bc3f-4aa1-8827-986877dca8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c55adc7-bc3f-4aa1-8827-986877dca8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92b82fc-9d3a-4fad-b61a-c6477bdc9de6', 'volume_name': 'volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb4dbe-152d-4d47-a40f-78cd0b35c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb4dbe-152d-4d47-a40f-78cd0b35c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac778510-6dc3-471a-b4dc-25862f1d9abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume a92b82fc-9d3a-4fad-b61a-c6477bdc9de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6', 'volume_size': 1}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (b3a90e18-37dc-47e6-a585-580a6eb576e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c507b52c-fd82-4e0a-9c4e-bf6658de3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c507b52c-fd82-4e0a-9c4e-bf6658de3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659099802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dee872-5acf-4678-a2f0-5f51571a4892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c6fb8d-be51-4a1b-87f9-fd464a234e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c6fb8d-be51-4a1b-87f9-fd464a234e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98a20f1-9020-4b9a-974c-77b508be713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98a20f1-9020-4b9a-974c-77b508be713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8dee872-5acf-4678-a2f0-5f51571a4892', 'volume_name': 'volume-a8dee872-5acf-4678-a2f0-5f51571a4892', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d710f3-976b-413d-8089-fec1c96de1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d710f3-976b-413d-8089-fec1c96de1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c406b538-bedf-439d-b49d-6b29fd1088f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume a8dee872-5acf-4678-a2f0-5f51571a4892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8dee872-5acf-4678-a2f0-5f51571a4892', 'volume_size': 1}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (ba05e467-ba4d-4a44-8115-2ea0bbd277a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb64f51-cc05-4049-8575-16011ac2a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb64f51-cc05-4049-8575-16011ac2a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817161752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69a987e-6036-4dda-ae12-bd0c352542f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a2e926-e36b-4a1c-9eca-10b06aeb8956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a2e926-e36b-4a1c-9eca-10b06aeb8956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b956c3d3-01a9-4b58-a3bf-1d4ad289fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b956c3d3-01a9-4b58-a3bf-1d4ad289fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69a987e-6036-4dda-ae12-bd0c352542f8', 'volume_name': 'volume-c69a987e-6036-4dda-ae12-bd0c352542f8', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd667f33-7af3-4114-b5c7-38cd908d0e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd667f33-7af3-4114-b5c7-38cd908d0e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd46cb6-5d06-4a0a-8760-b45fe7e4a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Volume c69a987e-6036-4dda-ae12-bd0c352542f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69a987e-6036-4dda-ae12-bd0c352542f8', 'volume_size': 1}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b" returned: 0 in 0.615s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121011003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f498df63-09e1-4779-875e-be67b6daec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume f498df63-09e1-4779-875e-be67b6daec81 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:46 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3b12c8-ddf1-4428-86af-f6b366417813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 1073741824
Apr 24 01:16:46 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792307e2-6fc5-4fac-aa59-7564a4be0bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:46 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b (67ac1bff-1962-4e51-9c88-ec79daf39a6b): created successfully
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792307e2-6fc5-4fac-aa59-7564a4be0bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (a09e6538-1b83-4925-8e46-e80c8b37b66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:46 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a4912012-e059-4fdc-ad6b-a908d157dada tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:46 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 1073741824" returned: 0 in 0.695s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:46 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81
Apr 24 01:16:46 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:47 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81" returned: 0 in 0.463s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614262418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87001548-99bf-4f61-8807-48c4308791f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:45Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume 87001548-99bf-4f61-8807-48c4308791f0 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:47 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a3ef36-8c85-46c2-acfb-667d278f9f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f498df63-09e1-4779-875e-be67b6daec81', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41b45bf-d18a-4871-bd28-e91438b3ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:47 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 1073741824
Apr 24 01:16:47 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:47 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-f498df63-09e1-4779-875e-be67b6daec81 (f498df63-09e1-4779-875e-be67b6daec81): created successfully
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41b45bf-d18a-4871-bd28-e91438b3ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (f7b2c7fb-8d33-422e-bb37-b2a59f54f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0f21257c-0853-4de4-bd9a-b74b521c3dfb tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:48 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 1073741824" returned: 0 in 0.637s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:48 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0
Apr 24 01:16:48 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:48 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0" returned: 0 in 0.551s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835357076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92b82fc-9d3a-4fad-b61a-c6477bdc9de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:48 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7350f315-db95-4b41-999e-002f20b03d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87001548-99bf-4f61-8807-48c4308791f0', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:48 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 1073741824
Apr 24 01:16:48 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c498a1-9298-4d5d-acee-f2f8db9c2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:48 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-87001548-99bf-4f61-8807-48c4308791f0 (87001548-99bf-4f61-8807-48c4308791f0): created successfully
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c498a1-9298-4d5d-acee-f2f8db9c2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:48 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (bdadd31b-31b7-4e40-b726-0836d10acc54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6fdec0e1-3381-4c34-b4b7-2f20a2b2b332 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:49 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 1073741824" returned: 0 in 0.660s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:49 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6
Apr 24 01:16:49 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:49 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" returned: 0 in 0.427s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659099802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dee872-5acf-4678-a2f0-5f51571a4892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47feae4a2b4adba07da1854d33250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='0973272bb90544bda09c5dc3801e3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Creating volume a8dee872-5acf-4678-a2f0-5f51571a4892 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:49 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac778510-6dc3-471a-b4dc-25862f1d9abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:49 devstack sudo[89335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 1073741824
Apr 24 01:16:49 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb071399-2ee6-4894-b1b5-2da6f6d3632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:49 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 (a92b82fc-9d3a-4fad-b61a-c6477bdc9de6): created successfully
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb071399-2ee6-4894-b1b5-2da6f6d3632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:49 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (4ab3dd4a-225c-4c90-b21d-b3396b1a46d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:49 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-08a3977a-3457-4587-bd59-e5166d4931d7 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:50 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 1073741824" returned: 0 in 0.639s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:50 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892
Apr 24 01:16:50 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:50 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892" returned: 0 in 0.514s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.801s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817161752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69a987e-6036-4dda-ae12-bd0c352542f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Creating volume c69a987e-6036-4dda-ae12-bd0c352542f8 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:50 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c406b538-bedf-439d-b49d-6b29fd1088f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dee872-5acf-4678-a2f0-5f51571a4892', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:51 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 1073741824
Apr 24 01:16:51 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1478bf-9015-463a-bf71-37cc659c57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Volume volume-a8dee872-5acf-4678-a2f0-5f51571a4892 (a8dee872-5acf-4678-a2f0-5f51571a4892): created successfully
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1478bf-9015-463a-bf71-37cc659c57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Flow 'volume_create_manager' (b3a90e18-37dc-47e6-a585-580a6eb576e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5239d0fc-b2f3-4d3e-9551-532b5b1af96e tempest-CreateVolumesFromSnapshotTest-573072334 None] Created volume successfully.
Apr 24 01:16:51 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 1073741824" returned: 0 in 0.696s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-a8dee872-5acf-4678-a2f0-5f51571a4892-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-a8dee872-5acf-4678-a2f0-5f51571a4892-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:51 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8
Apr 24 01:16:51 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-a8dee872-5acf-4678-a2f0-5f51571a4892" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-a8dee872-5acf-4678-a2f0-5f51571a4892" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0c86a-a655-4181-998b-72eaedce1425]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:51 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892
Apr 24 01:16:51 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:52 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8" returned: 0 in 0.501s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd46cb6-5d06-4a0a-8760-b45fe7e4a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69a987e-6036-4dda-ae12-bd0c352542f8', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473b11f-3872-4573-a559-a43f924c1340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:52 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Volume volume-c69a987e-6036-4dda-ae12-bd0c352542f8 (c69a987e-6036-4dda-ae12-bd0c352542f8): created successfully
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473b11f-3872-4573-a559-a43f924c1340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (ba05e467-ba4d-4a44-8115-2ea0bbd277a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d9e3c1b8-9c13-45dc-b4da-9ddb324cc0f1 tempest-VolumesListAdminTestJSON-2020979854 None] Created volume successfully.
Apr 24 01:16:52 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892" returned: 0 in 0.530s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:52 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892
Apr 24 01:16:52 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:52 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a8dee872-5acf-4678-a2f0-5f51571a4892" returned: 0 in 0.464s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-a8dee872-5acf-4678-a2f0-5f51571a4892" released by "delete_volume" :: held 1.042s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:52 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['b9f70f26-2bff-4457-b373-928cfcee5173', '3da3c6a9-eee7-40b3-97ef-66aeee33e271', '067e8f5f-bc18-4434-8477-171eaed83b58', '84a4ec40-abe2-40fb-9fac-50e81520c760'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:53 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:53 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (08b9617d-7edf-4ee5-9120-f93e18a7185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bc424f-4a01-4da7-871d-61250d8514f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bc424f-4a01-4da7-871d-61250d8514f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781031128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad450fb9-e168-4dbd-97c4-cf0e1e236060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:53Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd89d4-1cd8-458e-be06-4fa7d7e5c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd89d4-1cd8-458e-be06-4fa7d7e5c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2ecf75-b4d7-4c84-ae3e-7d61f455f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2ecf75-b4d7-4c84-ae3e-7d61f455f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad450fb9-e168-4dbd-97c4-cf0e1e236060', 'volume_name': 'volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c1973d-6c84-4b58-96eb-bb1cf15ecccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c1973d-6c84-4b58-96eb-bb1cf15ecccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205f0b9-e66e-4268-ac81-3dac861ab3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:53 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Volume ad450fb9-e168-4dbd-97c4-cf0e1e236060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060', 'volume_size': 1}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781031128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad450fb9-e168-4dbd-97c4-cf0e1e236060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5021604388b5486f9c7dabaf6eff2191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:53Z,use_quota=True,user_id='7f28f1f8e9d345068610c5c6e6609a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Creating volume ad450fb9-e168-4dbd-97c4-cf0e1e236060 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:53 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:53 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 1073741824
Apr 24 01:16:53 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:53 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.516s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-33d43576-9611-451f-bf51-ef9f7269cbfc tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-a8dee872-5acf-4678-a2f0-5f51571a4892-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:53 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 1073741824" returned: 0 in 0.691s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:53 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060
Apr 24 01:16:53 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0901f5-ea34-4e7f-b10b-c3ad2a98968d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:54 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6
Apr 24 01:16:54 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:54 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060" returned: 0 in 0.519s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205f0b9-e66e-4268-ac81-3dac861ab3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8000441-cff9-43a4-8a59-94e6f2056e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:54 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Volume volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 (ad450fb9-e168-4dbd-97c4-cf0e1e236060): created successfully
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8000441-cff9-43a4-8a59-94e6f2056e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Flow 'volume_create_manager' (08b9617d-7edf-4ee5-9120-f93e18a7185e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8291c508-f147-42c3-8a03-ea2b1be9f9e0 tempest-VolumesListAdminTestJSON-2020979854 None] Created volume successfully.
Apr 24 01:16:54 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:54 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6
Apr 24 01:16:54 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:55 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" returned: 0 in 0.497s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6" released by "delete_volume" :: held 1.082s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['67376a05-a43b-49a2-b495-8b89f8d499aa', 'c808a01d-480c-4001-8c30-6b31780a127d', '67e43994-72a5-4b4b-a1ec-c0dfcda7f100', 'cbfa7fc6-cffe-4ae5-bccf-522610409a76'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:55 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:55 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Flow 'volume_create_manager' (847b4232-de14-4e2a-9a70-268ebe961da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94723ae3-0f75-4fd6-94f2-c3c2fe671e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:55 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94723ae3-0f75-4fd6-94f2-c3c2fe671e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2728e2-d085-431e-af13-52f7b8af68d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2aa584cf65463db47c4d4263442d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:56Z,use_quota=True,user_id='aedb7ebeca244b7bbe8ce668d8833922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ba23d-e098-4ce1-93dd-82b3a3d5fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ba23d-e098-4ce1-93dd-82b3a3d5fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da675560-7651-42cd-805d-a5ac9865d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da675560-7651-42cd-805d-a5ac9865d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2728e2-d085-431e-af13-52f7b8af68d0', 'volume_name': 'volume-1d2728e2-d085-431e-af13-52f7b8af68d0', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc37e67-53e3-4e9b-975d-10b14f85fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc37e67-53e3-4e9b-975d-10b14f85fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c2655e-38f1-4220-af74-ee82ffa4f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Volume 1d2728e2-d085-431e-af13-52f7b8af68d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2728e2-d085-431e-af13-52f7b8af68d0', 'volume_size': 1}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2728e2-d085-431e-af13-52f7b8af68d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2aa584cf65463db47c4d4263442d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:56Z,use_quota=True,user_id='aedb7ebeca244b7bbe8ce668d8833922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Creating volume 1d2728e2-d085-431e-af13-52f7b8af68d0 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:16:55 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.618s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:55 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:16:55 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 1073741824
Apr 24 01:16:55 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-7f3abf7e-54e7-4cbd-98f5-51c1885fbb02 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-a92b82fc-9d3a-4fad-b61a-c6477bdc9de6-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-87001548-99bf-4f61-8807-48c4308791f0-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-87001548-99bf-4f61-8807-48c4308791f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-87001548-99bf-4f61-8807-48c4308791f0" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-87001548-99bf-4f61-8807-48c4308791f0" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbf122f-f0c7-4f78-acd4-24eaddd4a3f1]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:56 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0
Apr 24 01:16:56 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:56 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 1073741824" returned: 0 in 0.732s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:56 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0
Apr 24 01:16:56 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:57 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0" returned: 0 in 0.633s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:57 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0
Apr 24 01:16:57 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:57 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0" returned: 0 in 0.495s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c2655e-38f1-4220-af74-ee82ffa4f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2728e2-d085-431e-af13-52f7b8af68d0', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36377d84-db2a-40cd-a22d-489a1bfa40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:16:57 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Volume volume-1d2728e2-d085-431e-af13-52f7b8af68d0 (1d2728e2-d085-431e-af13-52f7b8af68d0): created successfully
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36377d84-db2a-40cd-a22d-489a1bfa40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Flow 'volume_create_manager' (847b4232-de14-4e2a-9a70-268ebe961da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:16:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e6ab5c50-c7e4-48f3-b13c-a7f9f59c5d57 tempest-VolumesListAdminTestJSON-996871297 None] Created volume successfully.
Apr 24 01:16:57 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-87001548-99bf-4f61-8807-48c4308791f0" returned: 0 in 0.468s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-87001548-99bf-4f61-8807-48c4308791f0" released by "delete_volume" :: held 1.145s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['d39aed77-574b-4a5d-9e79-235e6016e4ea', '3fc82adc-c408-48ee-a36e-61e72db794d6', '19e027ad-e7b3-4ec0-8fad-60e0879486a0', '121da787-140b-4501-bcf0-4807cb95fb29'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:57 devstack sudo[89398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:57 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:58 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Acquiring lock "cinder-1d2728e2-d085-431e-af13-52f7b8af68d0-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "cinder-1d2728e2-d085-431e-af13-52f7b8af68d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-06d738ca-5a34-4801-b5bf-d14fa9c0f958 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-87001548-99bf-4f61-8807-48c4308791f0-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Acquiring lock "cinder-quobyte-1d2728e2-d085-431e-af13-52f7b8af68d0" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "cinder-quobyte-1d2728e2-d085-431e-af13-52f7b8af68d0" acquired by "delete_volume" :: waited 0.014s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7168001-f2aa-4b2c-9dfd-ba9050dbb06c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-ad450fb9-e168-4dbd-97c4-cf0e1e236060-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-ad450fb9-e168-4dbd-97c4-cf0e1e236060-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-quobyte-ad450fb9-e168-4dbd-97c4-cf0e1e236060" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0
Apr 24 01:16:58 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-ad450fb9-e168-4dbd-97c4-cf0e1e236060" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ccc38-009a-4c5b-be95-6f5b4d518b98]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:58 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060
Apr 24 01:16:58 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-f498df63-09e1-4779-875e-be67b6daec81-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-f498df63-09e1-4779-875e-be67b6daec81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-f498df63-09e1-4779-875e-be67b6daec81" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-f498df63-09e1-4779-875e-be67b6daec81" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9eb0c-ea5c-4d8b-87a6-d98161832382]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:58 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81
Apr 24 01:16:58 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:58 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0" returned: 0 in 0.704s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:59 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0
Apr 24 01:16:59 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:59 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060" returned: 0 in 0.673s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:59 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060
Apr 24 01:16:59 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:59 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81" returned: 0 in 0.728s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:59 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81
Apr 24 01:16:59 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:59 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1d2728e2-d085-431e-af13-52f7b8af68d0" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "cinder-quobyte-1d2728e2-d085-431e-af13-52f7b8af68d0" released by "delete_volume" :: held 1.426s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Created reservations ['dd3feee4-cae0-45a4-86e1-901e033d28f1', '5f4f7df8-6188-4162-8a7c-a36a2e4b1cdd', '76aec41a-b75d-49e3-8643-bcd6935dac59', '82201ff2-baeb-4097-9ab9-f856f8d40d0c'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:59 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ad450fb9-e168-4dbd-97c4-cf0e1e236060" returned: 0 in 0.651s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-ad450fb9-e168-4dbd-97c4-cf0e1e236060" released by "delete_volume" :: held 1.371s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Created reservations ['11ad6da8-fd89-43fb-bc3a-79e4eb4a4d50', 'c6a9e77c-a99d-4e4d-aab1-159df674605c', 'c4fb69e3-815c-4d37-9559-5202268d425b', '338cda1e-3739-49b9-bd72-fe5471853c58'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:16:59 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:59 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:16:59 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f498df63-09e1-4779-875e-be67b6daec81" returned: 0 in 0.590s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:16:59 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:16:59 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:16:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-f498df63-09e1-4779-875e-be67b6daec81" released by "delete_volume" :: held 1.369s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['adae7ee2-5835-4c9a-a21e-ea6cfbbaeb73', '5acd43af-1918-470c-8cf2-9a61fc16c044', '6c4ca7d1-5341-475c-a577-ea2a418bb529', 'c7761fa1-5c19-464c-8bc7-f0bf1fbc6e05'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:00 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:00 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:00 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Deleted volume successfully.
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-f72e00a3-7fee-48b6-a8cc-8e59fb50eea7 tempest-VolumesListAdminTestJSON-996871297 None] Lock "cinder-1d2728e2-d085-431e-af13-52f7b8af68d0-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:00 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Deleted volume successfully.
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-72869733-006c-457e-b4dd-bbbb7601c5d8 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-ad450fb9-e168-4dbd-97c4-cf0e1e236060-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-c69a987e-6036-4dda-ae12-bd0c352542f8-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-c69a987e-6036-4dda-ae12-bd0c352542f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-quobyte-c69a987e-6036-4dda-ae12-bd0c352542f8" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-c69a987e-6036-4dda-ae12-bd0c352542f8" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:00 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.592s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2265bf-fd3e-4685-ae35-b47c38af5bcd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bfd31f55-03bf-4dec-afc0-8638576e39a1 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-f498df63-09e1-4779-875e-be67b6daec81-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-67ac1bff-1962-4e51-9c88-ec79daf39a6b-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-67ac1bff-1962-4e51-9c88-ec79daf39a6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:00 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8
Apr 24 01:17:00 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-67ac1bff-1962-4e51-9c88-ec79daf39a6b" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-67ac1bff-1962-4e51-9c88-ec79daf39a6b" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c33b8-c288-4d24-bc21-b8ccd30470a3]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:01 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b
Apr 24 01:17:01 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:01 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8" returned: 0 in 0.648s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:01 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8
Apr 24 01:17:01 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:01 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b" returned: 0 in 0.613s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:01 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b
Apr 24 01:17:01 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:01 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c69a987e-6036-4dda-ae12-bd0c352542f8" returned: 0 in 0.433s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-c69a987e-6036-4dda-ae12-bd0c352542f8" released by "delete_volume" :: held 1.135s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:01 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Created reservations ['17cb18c2-407d-4ac8-97a7-7399f5faf61d', '12637aa7-813e-4727-a164-d45e3d71b008', '7ca23fda-7b96-4cbc-8ae4-ac150c8906d3', 'b4a123f2-a5ee-4a72-b389-f34425313f53'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:02 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-67ac1bff-1962-4e51-9c88-ec79daf39a6b" returned: 0 in 0.487s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:02 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:02 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-67ac1bff-1962-4e51-9c88-ec79daf39a6b" released by "delete_volume" :: held 1.151s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['2e7bbff9-03ea-4b96-bba3-a4762898cb35', '3242bb22-4e4b-44aa-baea-257775d9b1fc', 'abf14916-9102-46e6-be10-289d833d47a6', '78b44aae-ea71-4502-9b54-43833236c3f7'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:02 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:02 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:02 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.498s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Deleted volume successfully.
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2880a18b-def2-4115-908b-7b0e6e2c2354 tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-c69a987e-6036-4dda-ae12-bd0c352542f8-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:02 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.501s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-51f7b476-df98-4eaa-abe6-4ca44a915187 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-67ac1bff-1962-4e51-9c88-ec79daf39a6b-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-de39088b-0e78-47ed-9091-4c4f790bfa0e-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-de39088b-0e78-47ed-9091-4c4f790bfa0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "cinder-quobyte-de39088b-0e78-47ed-9091-4c4f790bfa0e" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-de39088b-0e78-47ed-9091-4c4f790bfa0e" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-8225eed6-95c0-45b6-8fa3-3117d29146dd-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c8c36-0031-49b8-b25d-b1201fda0714]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-8225eed6-95c0-45b6-8fa3-3117d29146dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-8225eed6-95c0-45b6-8fa3-3117d29146dd" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-8225eed6-95c0-45b6-8fa3-3117d29146dd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleting offline snapshot 8225eed6-95c0-45b6-8fa3-3117d29146dd of volume 1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] snapshot_file for this snap is: volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc8370-255d-42f7-a13f-aaab05eb0c30]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:03 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e
Apr 24 01:17:03 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:03 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd
Apr 24 01:17:03 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:03 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e" returned: 0 in 0.693s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:03 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e
Apr 24 01:17:03 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:03 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd" returned: 0 in 0.659s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1032e282-41bd-4acd-91d4-d958786a8237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2f225-09a1-4c54-8aa7-cd93adab8379]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:03 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237
Apr 24 01:17:03 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:04 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-de39088b-0e78-47ed-9091-4c4f790bfa0e" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-quobyte-de39088b-0e78-47ed-9091-4c4f790bfa0e" released by "delete_volume" :: held 1.329s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Created reservations ['c937a388-cad2-489f-a0ac-5ce61923b1bd', '0218d393-75d9-4cb9-8986-e41fb05081f7', '7ef108c8-221e-4a14-ac9a-3a8a827041ee', 'f00bf923-dc91-4c33-84f3-515f9fb5c1e6'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:04 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:04 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:04 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:04 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd
Apr 24 01:17:04 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:05 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.495s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Deleted volume successfully.
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-557ff246-3c22-4112-bd9f-fad4e9ec853a tempest-VolumesListAdminTestJSON-2020979854 None] Lock "cinder-de39088b-0e78-47ed-9091-4c4f790bfa0e-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:05 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:05 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd
Apr 24 01:17:05 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:05 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237.8225eed6-95c0-45b6-8fa3-3117d29146dd" returned: 0 in 0.569s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-8225eed6-95c0-45b6-8fa3-3117d29146dd" released by "_delete_snapshot" :: held 2.670s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" released by "delete_snapshot" :: held 2.696s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['50029b39-d528-4cfe-98f8-45c086eabef8', 'e7b4f249-3fe7-41ae-925c-4c004a4bb4db', '33946e4e-e3f7-4ae5-b526-607279ada5c2', 'e7679262-1004-43ce-a6fe-61947f42a256'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:05 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Delete snapshot completed successfully.
Apr 24 01:17:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-71562f42-209d-4a71-949d-dc436961e9e5 tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-8225eed6-95c0-45b6-8fa3-3117d29146dd-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-1032e282-41bd-4acd-91d4-d958786a8237-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-1032e282-41bd-4acd-91d4-d958786a8237-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ac398a-eaf4-4e2c-ac93-6acf88710aab]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:06 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237
Apr 24 01:17:06 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:07 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237" returned: 0 in 0.794s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:07 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237
Apr 24 01:17:07 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:07 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1032e282-41bd-4acd-91d4-d958786a8237" returned: 0 in 0.605s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-quobyte-1032e282-41bd-4acd-91d4-d958786a8237" released by "delete_volume" :: held 1.482s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Created reservations ['595f280a-4956-427e-a84a-5d2336b20364', '3715c1bb-38d4-4ae5-a6f1-6cbd6b6f4a51', '8842c3ef-871b-457b-9a07-715711a1f437', '377f702a-6ad4-464f-8c86-95a6447c4a1d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:08 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:08 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:08 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.589s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Deleted volume successfully.
Apr 24 01:17:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a6c66743-f72d-4c29-a213-fb4c8dcba31c tempest-CreateVolumesFromSnapshotTest-573072334 None] Lock "cinder-1032e282-41bd-4acd-91d4-d958786a8237-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Flow 'volume_create_manager' (25be88de-0c2f-4b00-8a70-c057b2a13217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85a4579-089c-4661-a95d-759aec20a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85a4579-089c-4661-a95d-759aec20a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1268388157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a8a981-938f-4af2-8756-d10dadf3d7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f77e8912244438647c4aeb8acc715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:11Z,use_quota=True,user_id='aa0f4e5915cd455d903613803c381409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab96f0d3-e545-49cd-91cf-7a4492434244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab96f0d3-e545-49cd-91cf-7a4492434244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae86bdc-2073-4ed3-8f55-16f0b7e3e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae86bdc-2073-4ed3-8f55-16f0b7e3e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a8a981-938f-4af2-8756-d10dadf3d7c2', 'volume_name': 'volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15129963-b873-4304-a8a1-73071484b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15129963-b873-4304-a8a1-73071484b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdeac27-4761-4d6a-8e49-b99f0c86b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Volume e9a8a981-938f-4af2-8756-d10dadf3d7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2', 'volume_size': 1}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1268388157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a8a981-938f-4af2-8756-d10dadf3d7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f77e8912244438647c4aeb8acc715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:11Z,use_quota=True,user_id='aa0f4e5915cd455d903613803c381409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Creating volume e9a8a981-938f-4af2-8756-d10dadf3d7c2 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:10 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:17:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:10 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 1073741824
Apr 24 01:17:10 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:11 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 1073741824" returned: 0 in 0.838s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:11 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2
Apr 24 01:17:11 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:12 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2" returned: 0 in 0.678s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=130,cinder:UPDATE=205,cinder:INSERT=47,cinder:DELETE=10 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdeac27-4761-4d6a-8e49-b99f0c86b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4675895-8e90-494a-a245-6affe9be5719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:INSERT=42,cinder:UPDATE=175,cinder:SELECT=124,cinder:DELETE=23 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:17:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Volume volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 (e9a8a981-938f-4af2-8756-d10dadf3d7c2): created successfully
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4675895-8e90-494a-a245-6affe9be5719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Flow 'volume_create_manager' (25be88de-0c2f-4b00-8a70-c057b2a13217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6d24bd11-38dd-41a4-a52a-0b047ec29a09 tempest-AbsoluteLimitsTests-48221465 None] Created volume successfully.
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Acquiring lock "cinder-e9a8a981-938f-4af2-8756-d10dadf3d7c2-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "cinder-e9a8a981-938f-4af2-8756-d10dadf3d7c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Acquiring lock "cinder-quobyte-e9a8a981-938f-4af2-8756-d10dadf3d7c2" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "cinder-quobyte-e9a8a981-938f-4af2-8756-d10dadf3d7c2" acquired by "delete_volume" :: waited 0.031s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb5995-ea6f-4292-9b8f-119b7d3a43fb]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:13 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2
Apr 24 01:17:13 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:14 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2" returned: 0 in 0.676s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:14 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2
Apr 24 01:17:14 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:14 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e9a8a981-938f-4af2-8756-d10dadf3d7c2" returned: 0 in 0.629s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "cinder-quobyte-e9a8a981-938f-4af2-8756-d10dadf3d7c2" released by "delete_volume" :: held 1.357s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Created reservations ['9a5b55ee-e770-490a-a3f3-6438bbea06af', '2ad57181-ab43-461b-b584-a6c8881d9be2', '56425a6c-6f90-463c-a64a-22628db0f501', '5798e69d-33ab-48aa-bf81-5877b1a4d1db'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:14 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:14 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:15 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.562s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:15 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Deleted volume successfully.
Apr 24 01:17:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e8963177-652e-4f48-b179-202822084199 tempest-AbsoluteLimitsTests-48221465 None] Lock "cinder-e9a8a981-938f-4af2-8756-d10dadf3d7c2-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:19 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:19 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:19 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (d34cdba0-f88e-410c-bfde-8a166ed060b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ff0e09-5019-474d-a724-9a56face5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ff0e09-5019-474d-a724-9a56face5463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1432318606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406705bf-97e7-41e7-bbd4-084818fc33ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bb528aa24e999de892a64e3af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:21Z,use_quota=True,user_id='6bbe3964d563408c82cfa6f22b69795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4557ad42-4933-4054-9cad-5a65695e05c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4557ad42-4933-4054-9cad-5a65695e05c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aceeb43-5961-4b55-850e-fc7ddaae10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aceeb43-5961-4b55-850e-fc7ddaae10d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406705bf-97e7-41e7-bbd4-084818fc33ca', 'volume_name': 'volume-406705bf-97e7-41e7-bbd4-084818fc33ca', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfef13f-51da-4c25-921f-7919ffa9a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfef13f-51da-4c25-921f-7919ffa9a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f281ae9-c5e5-4261-b9de-4b853613cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:20 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Volume 406705bf-97e7-41e7-bbd4-084818fc33ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406705bf-97e7-41e7-bbd4-084818fc33ca', 'volume_size': 1}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1432318606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406705bf-97e7-41e7-bbd4-084818fc33ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bb528aa24e999de892a64e3af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:21Z,use_quota=True,user_id='6bbe3964d563408c82cfa6f22b69795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Creating volume 406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:21 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:21 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca 1073741824
Apr 24 01:17:21 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:21 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca 1073741824" returned: 0 in 0.711s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:21 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca
Apr 24 01:17:21 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:22 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca" returned: 0 in 0.564s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f281ae9-c5e5-4261-b9de-4b853613cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406705bf-97e7-41e7-bbd4-084818fc33ca', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7bb067-117f-44a5-9cb8-8f04a8f00c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:22 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Volume volume-406705bf-97e7-41e7-bbd4-084818fc33ca (406705bf-97e7-41e7-bbd4-084818fc33ca): created successfully
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7bb067-117f-44a5-9cb8-8f04a8f00c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:22 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (d34cdba0-f88e-410c-bfde-8a166ed060b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:22 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-35cb4389-9486-4cc5-b9cb-6b7406042ea0 tempest-VolumesDeleteCascade-1123244833 None] Created volume successfully.
Apr 24 01:17:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Creating offline snapshot 6e58a891-9b54-45db-afe7-58a5470abb91 of volume 406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:17:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ceda7-e479-4e99-bf15-d55c2bd6bc73]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:23 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca
Apr 24 01:17:23 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:24 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca" returned: 0 in 0.776s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:24 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 1G
Apr 24 01:17:24 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:24 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 1G" returned: 0 in 0.721s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:24 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:24 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:25 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.620s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:25 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 is being set with open permissions: ugo+rw
Apr 24 01:17:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:25 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:25 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:25 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.487s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:26 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info
Apr 24 01:17:26 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:26 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info" returned: 0 in 0.527s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:26 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info is being set with open permissions: ugo+rw
Apr 24 01:17:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:26 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info
Apr 24 01:17:26 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:26 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.info" returned: 0 in 0.491s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.733s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bfc334c7-96eb-4404-8136-f0bf0a805bda tempest-VolumesDeleteCascade-1123244833 None] Create snapshot completed successfully
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Creating offline snapshot 39811894-dfec-40bd-88fb-5e6a131c01c1 of volume 406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4110ea74-8100-406f-9ae3-4bbb19584cef]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:27 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:27 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:28 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.620s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406705bf-97e7-41e7-bbd4-084818fc33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:28 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 1G
Apr 24 01:17:28 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:29 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 1G" returned: 0 in 0.721s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:29 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1
Apr 24 01:17:29 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:29 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1" returned: 0 in 0.551s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:29 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 is being set with open permissions: ugo+rw
Apr 24 01:17:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:29 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1
Apr 24 01:17:29 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:30 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1" returned: 0 in 0.479s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:30 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-93dc9a36-3a75-4ecd-a2af-a0fa6abdf433 tempest-VolumesDeleteCascade-1123244833 None] Create snapshot completed successfully
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-406705bf-97e7-41e7-bbd4-084818fc33ca-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-406705bf-97e7-41e7-bbd4-084818fc33ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Performing cascade delete. {{(pid=81902) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-39811894-dfec-40bd-88fb-5e6a131c01c1-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-39811894-dfec-40bd-88fb-5e6a131c01c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-39811894-dfec-40bd-88fb-5e6a131c01c1" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-39811894-dfec-40bd-88fb-5e6a131c01c1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Deleting offline snapshot 39811894-dfec-40bd-88fb-5e6a131c01c1 of volume 406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] snapshot_file for this snap is: volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123fa86-0102-49f3-92dc-cdd2b22d9773]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:31 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1
Apr 24 01:17:31 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:31 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1" returned: 0 in 0.646s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406705bf-97e7-41e7-bbd4-084818fc33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[454bc9fa-9360-4c29-b127-5bc179ab8c82]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:31 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:31 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:32 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.599s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406705bf-97e7-41e7-bbd4-084818fc33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:32 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1
Apr 24 01:17:32 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:33 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1" returned: 0 in 0.863s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:33 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1
Apr 24 01:17:33 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:33 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.39811894-dfec-40bd-88fb-5e6a131c01c1" returned: 0 in 0.524s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-39811894-dfec-40bd-88fb-5e6a131c01c1" released by "_delete_snapshot" :: held 2.760s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" released by "delete_snapshot" :: held 2.791s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['ca19a951-14a9-4e01-bb42-5e4586eadd35', '35cb65fb-7a0d-4714-b0ce-9a6be04df970', '080096b3-11c0-4a79-b338-b786620ac4ac', 'dbc42568-fd87-4fc3-8ebb-32e96c7e7fc2'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:33 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Delete snapshot completed successfully.
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-39811894-dfec-40bd-88fb-5e6a131c01c1-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-6e58a891-9b54-45db-afe7-58a5470abb91-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-6e58a891-9b54-45db-afe7-58a5470abb91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-6e58a891-9b54-45db-afe7-58a5470abb91" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-6e58a891-9b54-45db-afe7-58a5470abb91" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Deleting offline snapshot 6e58a891-9b54-45db-afe7-58a5470abb91 of volume 406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] snapshot_file for this snap is: volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d26a26-8e5f-43aa-a939-38724b590122]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:34 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:34 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:34 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.613s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406705bf-97e7-41e7-bbd4-084818fc33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220a5ec-e03c-4506-82a2-a8a6bb6ce679]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:34 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca
Apr 24 01:17:34 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:35 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca" returned: 0 in 0.761s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:35 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:35 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:36 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.645s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:36 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91
Apr 24 01:17:36 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Flow 'volume_create_manager' (61af0723-a145-4ec3-9a67-ca24bcc3bf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837637a-301a-4418-b5e8-b1ce0eac8aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837637a-301a-4418-b5e8-b1ce0eac8aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-4671833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a6412-9f2b-45e5-a073-d9415e6ee645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43bf8a5e3543c6812887d1e788441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:36Z,use_quota=True,user_id='a5912cc5c03642b291d3c7553fd3b4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d39f5-1e63-4cb2-ab96-efa78ad87bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d39f5-1e63-4cb2-ab96-efa78ad87bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4d5fa7-31ed-4d54-a52e-ae2e8e860644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4d5fa7-31ed-4d54-a52e-ae2e8e860644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681a6412-9f2b-45e5-a073-d9415e6ee645', 'volume_name': 'volume-681a6412-9f2b-45e5-a073-d9415e6ee645', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4c8b9e-05d9-4802-92af-2bf93bab7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4c8b9e-05d9-4802-92af-2bf93bab7513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5eed09-d431-47ea-b5b0-fd51159cf36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:36 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Volume 681a6412-9f2b-45e5-a073-d9415e6ee645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681a6412-9f2b-45e5-a073-d9415e6ee645', 'volume_size': 1}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-4671833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a6412-9f2b-45e5-a073-d9415e6ee645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43bf8a5e3543c6812887d1e788441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:36Z,use_quota=True,user_id='a5912cc5c03642b291d3c7553fd3b4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Creating volume 681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:36 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:36 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 1073741824
Apr 24 01:17:36 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:36 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca.6e58a891-9b54-45db-afe7-58a5470abb91" returned: 0 in 0.564s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-6e58a891-9b54-45db-afe7-58a5470abb91" released by "_delete_snapshot" :: held 2.708s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" released by "delete_snapshot" :: held 2.736s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['9111295c-a48a-4f72-8064-c9c1b9a55ab8', 'a88998ad-b530-4ac0-9519-1c07a43a59ae', '35c916af-308a-4e69-a6cb-b94645674c58', 'c6594f7d-8d8b-477c-a929-dedfa89c5baa'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Delete snapshot completed successfully.
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-6e58a891-9b54-45db-afe7-58a5470abb91-delete_snapshot" released by "delete_snapshot" :: held 2.891s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Snapshots deleted, issuing volume delete {{(pid=81902) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7c4f1-9bbe-4495-a0d3-9c6e4ffee2bb]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:36 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca
Apr 24 01:17:37 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:37 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 1073741824" returned: 0 in 0.729s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:37 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:37 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:37 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca" returned: 0 in 0.661s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:37 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca
Apr 24 01:17:37 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:37 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.515s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5eed09-d431-47ea-b5b0-fd51159cf36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681a6412-9f2b-45e5-a073-d9415e6ee645', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5bbdff-4360-4d7e-a89d-74f7aa5cda4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:37 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Volume volume-681a6412-9f2b-45e5-a073-d9415e6ee645 (681a6412-9f2b-45e5-a073-d9415e6ee645): created successfully
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5bbdff-4360-4d7e-a89d-74f7aa5cda4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:37 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Flow 'volume_create_manager' (61af0723-a145-4ec3-9a67-ca24bcc3bf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:37 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-41e898eb-7bd8-4c9a-9c81-f2a06f4b580c tempest-SnapshotDependencyTests-1407053312 None] Created volume successfully.
Apr 24 01:17:38 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-406705bf-97e7-41e7-bbd4-084818fc33ca" returned: 0 in 0.513s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-406705bf-97e7-41e7-bbd4-084818fc33ca" released by "delete_volume" :: held 1.232s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['dbe7394e-bbd9-4d5c-9ab6-2cbcd9d4649c', '98f0a867-51f6-4db7-8495-4a11d6d3a40c', '4217d822-0a63-4ca0-bf4c-5f5222fcf34c', 'de733751-4492-49c8-9c8a-d8e37a553469'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:38 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:38 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:38 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:38 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Deleted volume successfully.
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-dd02471a-09ae-4c27-b326-7917197dfa79 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-406705bf-97e7-41e7-bbd4-084818fc33ca-delete_volume" released by "delete_volume" :: held 7.946s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Creating offline snapshot 33d12017-8e16-4dad-885c-192455f17a98 of volume 681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9da7e10-d281-45ba-a9ef-28bdc2b153e9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:39 devstack sudo[89673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:39 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (aabce29e-5fd8-49a2-9bd9-7306ef87d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbe4033-7f7f-4669-9385-b74ebf210d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbe4033-7f7f-4669-9385-b74ebf210d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1974924987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6644b1-9187-459d-ad3e-a0a29941aa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bb528aa24e999de892a64e3af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:39Z,use_quota=True,user_id='6bbe3964d563408c82cfa6f22b69795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd420383-f103-4aff-b826-ab7e39a02185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd420383-f103-4aff-b826-ab7e39a02185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad75f31-0163-4cec-b1c6-5ed046a5ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad75f31-0163-4cec-b1c6-5ed046a5ac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6644b1-9187-459d-ad3e-a0a29941aa63', 'volume_name': 'volume-cf6644b1-9187-459d-ad3e-a0a29941aa63', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d810dd03-e360-4998-84dd-2d7bd0cc5e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d810dd03-e360-4998-84dd-2d7bd0cc5e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a020343-77e6-4170-9ee1-f80e78b7717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:39 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Volume cf6644b1-9187-459d-ad3e-a0a29941aa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6644b1-9187-459d-ad3e-a0a29941aa63', 'volume_size': 1}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:39 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.604s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:39 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 1G
Apr 24 01:17:39 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:40 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 1G" returned: 0 in 0.667s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a6412-9f2b-45e5-a073-d9415e6ee645 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:40 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a6412-9f2b-45e5-a073-d9415e6ee645 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:40 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:40 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a6412-9f2b-45e5-a073-d9415e6ee645 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:40 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 is being set with open permissions: ugo+rw
Apr 24 01:17:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:40 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:40 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:41 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.504s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:41 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info
Apr 24 01:17:41 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:41 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info" returned: 0 in 0.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:41 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info is being set with open permissions: ugo+rw
Apr 24 01:17:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:41 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info
Apr 24 01:17:41 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:42 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.info" returned: 0 in 0.488s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.443s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.182s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1974924987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6644b1-9187-459d-ad3e-a0a29941aa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bb528aa24e999de892a64e3af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:39Z,use_quota=True,user_id='6bbe3964d563408c82cfa6f22b69795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Creating volume cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:42 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:17:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:42 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 1073741824
Apr 24 01:17:42 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-90ba892a-f2b0-4350-a00b-ab50c7a089dd tempest-SnapshotDependencyTests-1407053312 None] Create snapshot completed successfully
Apr 24 01:17:43 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 1073741824" returned: 0 in 0.697s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:43 devstack sudo[89703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:17:43 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Flow 'volume_create_manager' (a748d349-c1d7-4e3d-81d3-9d7489a65395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b625534-2f0b-46bc-ab3d-15e7013bdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b625534-2f0b-46bc-ab3d-15e7013bdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1869314c-4fbb-45e5-9fb1-1490614caa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43bf8a5e3543c6812887d1e788441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33d12017-8e16-4dad-885c-192455f17a98,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:43Z,use_quota=True,user_id='a5912cc5c03642b291d3c7553fd3b4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc965044-f240-42b4-8258-830c475f4a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc965044-f240-42b4-8258-830c475f4a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d7dee-3d83-49bf-9378-fc0c4519a572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d7dee-3d83-49bf-9378-fc0c4519a572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1869314c-4fbb-45e5-9fb1-1490614caa51', 'volume_name': 'volume-1869314c-4fbb-45e5-9fb1-1490614caa51', 'volume_size': 1, 'snapshot_id': '33d12017-8e16-4dad-885c-192455f17a98'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53044df1-c989-4f46-bf78-3c9b6626f9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53044df1-c989-4f46-bf78-3c9b6626f9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fdd05f-681b-4874-a84f-53ec6144d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Volume 1869314c-4fbb-45e5-9fb1-1490614caa51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1869314c-4fbb-45e5-9fb1-1490614caa51', 'volume_size': 1, 'snapshot_id': '33d12017-8e16-4dad-885c-192455f17a98'}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:43 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.552s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.018s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98-1869314c-4fbb-45e5-9fb1-1490614caa51" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a020343-77e6-4170-9ee1-f80e78b7717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6644b1-9187-459d-ad3e-a0a29941aa63', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d876ac61-5967-4caf-b058-90160d2903ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98-1869314c-4fbb-45e5-9fb1-1490614caa51" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Creating volume 1869314c-4fbb-45e5-9fb1-1490614caa51 from snapshot 33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:43 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Volume volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 (cf6644b1-9187-459d-ad3e-a0a29941aa63): created successfully
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d876ac61-5967-4caf-b058-90160d2903ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (aabce29e-5fd8-49a2-9bd9-7306ef87d16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c1b6fbc3-1a52-4ccb-bc1e-84954e8dbbe9 tempest-VolumesDeleteCascade-1123244833 None] Created volume successfully.
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] snapshot: 33d12017-8e16-4dad-885c-192455f17a98, volume: 1869314c-4fbb-45e5-9fb1-1490614caa51,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f3eb3-0294-485e-a21f-9cb9966554b5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:43 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:43 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:44 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.558s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a6412-9f2b-45e5-a073-d9415e6ee645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd1aee-59b4-4e76-b3b9-ba67c27af117]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:44 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:44 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:44 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.585s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:17:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:44 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51
Apr 24 01:17:44 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:49 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51" returned: 0 in 4.735s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:49 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db5e58-1ba3-4885-b2b3-378c4d4bb4bc]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:49 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:49 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:50 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.702s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:17:50 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Converted 1024.00 MB image at 216.20 MB/s
Apr 24 01:17:50 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 is being set with open permissions: ugo+rw
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:50 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51
Apr 24 01:17:50 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:50 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51" returned: 0 in 0.484s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" released by "_copy_volume_from_snapshot" :: held 7.166s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98-1869314c-4fbb-45e5-9fb1-1490614caa51" released by "_create_volume_from_snapshot" :: held 7.229s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.263s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.310s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Creating offline snapshot a9d28059-b699-4760-becd-86477d5d227d of volume cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fdd05f-681b-4874-a84f-53ec6144d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1869314c-4fbb-45e5-9fb1-1490614caa51', 'volume_size': 1, 'snapshot_id': '33d12017-8e16-4dad-885c-192455f17a98'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f2cfad-bb39-4329-85c3-e25500c91953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af1a49-ae48-4c03-8eac-3bc85e7022c6]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:50 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Volume volume-1869314c-4fbb-45e5-9fb1-1490614caa51 (1869314c-4fbb-45e5-9fb1-1490614caa51): created successfully
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f2cfad-bb39-4329-85c3-e25500c91953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Flow 'volume_create_manager' (a748d349-c1d7-4e3d-81d3-9d7489a65395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-00113736-64f8-49c2-8bc9-fdae0a5be6db tempest-SnapshotDependencyTests-1407053312 None] Created volume successfully.
Apr 24 01:17:51 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:17:51 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-33d12017-8e16-4dad-885c-192455f17a98-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-33d12017-8e16-4dad-885c-192455f17a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Deleting offline snapshot 33d12017-8e16-4dad-885c-192455f17a98 of volume 681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] snapshot_file for this snap is: volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e55d393-7263-4299-a425-ba6ba0f21f7c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:51 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:51 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:51 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.613s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:51 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d 1G
Apr 24 01:17:51 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:51 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.589s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a6412-9f2b-45e5-a073-d9415e6ee645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a7137a-c2e7-446e-9536-6802e346b017]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:52 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:52 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:52 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d 1G" returned: 0 in 0.708s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:52 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:17:52 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:52 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.585s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:52 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:52 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:52 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:52 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d is being set with open permissions: ugo+rw
Apr 24 01:17:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:52 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:17:52 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:53 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.623s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:53 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98
Apr 24 01:17:53 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:53 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.569s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:53 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info
Apr 24 01:17:53 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:53 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645.33d12017-8e16-4dad-885c-192455f17a98" returned: 0 in 0.538s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-33d12017-8e16-4dad-885c-192455f17a98" released by "_delete_snapshot" :: held 2.463s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" released by "delete_snapshot" :: held 2.491s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Created reservations ['e4b15f91-44c9-4bb0-bbac-ff8ea70c1e57', '2dc06846-4d9e-47c5-88f2-d6f6ffa957e0', 'ee9d20ac-1a57-4a94-a25b-35498bdf63a7', 'a8e09dbb-257b-4260-ae1e-3229df740cbf'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Delete snapshot completed successfully.
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1e436680-9e3e-4883-877e-0d4961563fbd tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-33d12017-8e16-4dad-885c-192455f17a98-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:53 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info" returned: 0 in 0.466s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:53 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info is being set with open permissions: ugo+rw
Apr 24 01:17:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:53 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info
Apr 24 01:17:53 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:54 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.info" returned: 0 in 0.498s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-681a6412-9f2b-45e5-a073-d9415e6ee645-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9977f5a5-c65a-4e00-945d-10e506055f9e tempest-VolumesDeleteCascade-1123244833 None] Create snapshot completed successfully
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-681a6412-9f2b-45e5-a073-d9415e6ee645-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2472318e-912d-4d1f-b9c2-a11c20169028]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:54 devstack sudo[89781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:54 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:55 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.614s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:55 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645
Apr 24 01:17:55 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (980df871-ba50-4e19-b90d-30ce465a8775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf0cec-d46d-4669-9b58-b2bf0b0dc6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf0cec-d46d-4669-9b58-b2bf0b0dc6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-791480097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724df75b-4c61-4110-a215-0787b33f8233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bb528aa24e999de892a64e3af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9d28059-b699-4760-becd-86477d5d227d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:55Z,use_quota=True,user_id='6bbe3964d563408c82cfa6f22b69795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95116af2-c435-4541-847f-2179a4d4bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95116af2-c435-4541-847f-2179a4d4bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e4ad5-ef53-42e4-b616-b5444f523d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e4ad5-ef53-42e4-b616-b5444f523d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '724df75b-4c61-4110-a215-0787b33f8233', 'volume_name': 'volume-724df75b-4c61-4110-a215-0787b33f8233', 'volume_size': 1, 'snapshot_id': 'a9d28059-b699-4760-becd-86477d5d227d'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03150519-b4b7-481d-9ea1-8f9a78be61fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03150519-b4b7-481d-9ea1-8f9a78be61fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f2827f-e2bc-4446-800a-6d35ae7215b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:17:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Volume 724df75b-4c61-4110-a215-0787b33f8233: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-724df75b-4c61-4110-a215-0787b33f8233', 'volume_size': 1, 'snapshot_id': 'a9d28059-b699-4760-becd-86477d5d227d'}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d-724df75b-4c61-4110-a215-0787b33f8233" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d-724df75b-4c61-4110-a215-0787b33f8233" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Creating volume 724df75b-4c61-4110-a215-0787b33f8233 from snapshot a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] snapshot: a9d28059-b699-4760-becd-86477d5d227d, volume: 724df75b-4c61-4110-a215-0787b33f8233,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1f3297-74bb-4488-bed0-63d3b99f475b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:55 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:17:55 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:55 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-681a6412-9f2b-45e5-a073-d9415e6ee645" returned: 0 in 0.551s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-681a6412-9f2b-45e5-a073-d9415e6ee645" released by "delete_volume" :: held 1.243s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Created reservations ['d0bc9fa3-bff2-453a-a0b3-8cfa62973a6e', '0b2c9d95-ad38-457a-a588-e103dc1e2ceb', '704d0c2f-ad2b-44c6-aea2-f4688cdc21d3', '414ea582-023a-4ff6-9615-822a1ba970f3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:55 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:55 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:56 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.617s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6644b1-9187-459d-ad3e-a0a29941aa63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe813552-d82b-4ca4-9900-3e0b26590ea9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:56 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:17:56 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:56 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:17:56 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Deleted volume successfully.
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5c10d86d-9dd3-4479-bb81-c617f5f68095 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-681a6412-9f2b-45e5-a073-d9415e6ee645-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-1869314c-4fbb-45e5-9fb1-1490614caa51-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-1869314c-4fbb-45e5-9fb1-1490614caa51-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6cca52-f926-440a-8b9c-26564c6704f7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:56 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51
Apr 24 01:17:56 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:56 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.609s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:17:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:56 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233
Apr 24 01:17:56 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:57 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51" returned: 0 in 0.634s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:57 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51
Apr 24 01:17:57 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:17:58 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1869314c-4fbb-45e5-9fb1-1490614caa51" returned: 0 in 0.817s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-quobyte-1869314c-4fbb-45e5-9fb1-1490614caa51" released by "delete_volume" :: held 1.500s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Created reservations ['90809f5f-1697-447d-b8fa-11f0a01ba471', 'faa895c8-6707-465b-8bcc-30a50051256f', '334eff70-3f79-4ccd-8b89-33eefe4c3d8b', '911fdf83-e018-4722-8234-aff778aebcf5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:17:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:17:58 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:17:58 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:00 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.629s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:00 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Deleted volume successfully.
Apr 24 01:18:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ab65b09d-6860-41c3-a56e-c33f60f24222 tempest-SnapshotDependencyTests-1407053312 None] Lock "cinder-1869314c-4fbb-45e5-9fb1-1490614caa51-delete_volume" released by "delete_volume" :: held 3.633s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:02 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233" returned: 0 in 5.817s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:02 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[79845a34-a977-4aa6-b63f-e0cb6d177259]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:02 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:18:02 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:03 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.695s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:03 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:18:03 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Converted 1024.00 MB image at 176.02 MB/s
Apr 24 01:18:03 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 is being set with open permissions: ugo+rw
Apr 24 01:18:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:03 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233
Apr 24 01:18:03 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:04 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233" returned: 0 in 0.533s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" released by "_copy_volume_from_snapshot" :: held 8.365s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d-724df75b-4c61-4110-a215-0787b33f8233" released by "_create_volume_from_snapshot" :: held 8.397s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.424s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f2827f-e2bc-4446-800a-6d35ae7215b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724df75b-4c61-4110-a215-0787b33f8233', 'volume_size': 1, 'snapshot_id': 'a9d28059-b699-4760-becd-86477d5d227d'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2f4916-5f9e-4b14-9c27-e3cbf06488e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Volume volume-724df75b-4c61-4110-a215-0787b33f8233 (724df75b-4c61-4110-a215-0787b33f8233): created successfully
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2f4916-5f9e-4b14-9c27-e3cbf06488e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Flow 'volume_create_manager' (980df871-ba50-4e19-b90d-30ce465a8775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ec918bc8-848a-4926-bcd5-abdba9140391 tempest-VolumesDeleteCascade-1123244833 None] Created volume successfully.
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-cf6644b1-9187-459d-ad3e-a0a29941aa63-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-cf6644b1-9187-459d-ad3e-a0a29941aa63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Performing cascade delete. {{(pid=81902) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-a9d28059-b699-4760-becd-86477d5d227d-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-a9d28059-b699-4760-becd-86477d5d227d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Deleting offline snapshot a9d28059-b699-4760-becd-86477d5d227d of volume cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] snapshot_file for this snap is: volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[228df2b3-0e18-42e8-aca3-52d3c0e0e3e3]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:04 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:18:04 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:05 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.594s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:05 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6644b1-9187-459d-ad3e-a0a29941aa63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:18:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98946f3-d05d-472a-93ee-5484d82af85b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:05 devstack sudo[89841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:18:05 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:06 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.583s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:06 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:18:06 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:06 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.602s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:06 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d
Apr 24 01:18:06 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:07 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63.a9d28059-b699-4760-becd-86477d5d227d" returned: 0 in 0.524s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-a9d28059-b699-4760-becd-86477d5d227d" released by "_delete_snapshot" :: held 2.438s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" released by "delete_snapshot" :: held 2.474s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['54b297b6-2b2f-449e-99b9-d7e88d3f37d3', '0d09d277-fc9a-4a27-8cdc-b402fbb1f40f', 'a92ffc1a-ac0c-47e7-bbfa-36c726d5abe6', '04342ecc-162e-4fac-89b8-03d356c7dbc0'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Delete snapshot completed successfully.
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-a9d28059-b699-4760-becd-86477d5d227d-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Snapshots deleted, issuing volume delete {{(pid=81902) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[26baf25c-a4f5-4888-a0fa-fdf81418d0d7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:07 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:18:07 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:08 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:08 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63
Apr 24 01:18:08 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:08 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-cf6644b1-9187-459d-ad3e-a0a29941aa63" returned: 0 in 0.548s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-cf6644b1-9187-459d-ad3e-a0a29941aa63" released by "delete_volume" :: held 1.197s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['96a901e1-c2c5-467b-b43a-fdeb0eff9ffa', 'adf8a562-7a6b-48eb-aaac-765f7e416c5f', 'bae047a0-23d3-4225-bdc6-15d88c2cd8f8', 'e1abed65-27ab-46ee-8f04-7d184e43a13d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:08 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:08 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-724df75b-4c61-4110-a215-0787b33f8233-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-724df75b-4c61-4110-a215-0787b33f8233-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1420d9c5-b315-4b05-bbd2-677005a46473]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:09 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.556s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:09 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233
Apr 24 01:18:09 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:09 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Deleted volume successfully.
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0a796f54-1b9f-433c-90e4-d02bdf838a1f tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-cf6644b1-9187-459d-ad3e-a0a29941aa63-delete_volume" released by "delete_volume" :: held 4.783s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:09 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233" returned: 0 in 0.613s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:09 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233
Apr 24 01:18:09 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:10 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-724df75b-4c61-4110-a215-0787b33f8233" returned: 0 in 0.596s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-quobyte-724df75b-4c61-4110-a215-0787b33f8233" released by "delete_volume" :: held 1.260s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Created reservations ['f59e5235-26ec-406b-8bdb-559eb078aae0', '5e0a7b98-d43f-4e07-bdc3-6e9479839562', '9aee33c5-7f94-4f79-8ec9-f1aa2b2f1748', '3a8d872c-ad57-4f95-a64b-034b1d59bc65'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:10 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:10 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:11 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.553s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:11 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:11 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Deleted volume successfully.
Apr 24 01:18:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eafaef3d-19ec-41d2-8103-de9090c09d28 tempest-VolumesDeleteCascade-1123244833 None] Lock "cinder-724df75b-4c61-4110-a215-0787b33f8233-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=79,cinder:INSERT=19,cinder:UPDATE=86,cinder:DELETE=4 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=94,cinder:DELETE=12,cinder:SELECT=74,cinder:INSERT=27 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (7de3dfb0-cba3-48c9-900b-b40d931189f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423b98ba-ad8e-43cf-a7f8-03d681a7b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423b98ba-ad8e-43cf-a7f8-03d681a7b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893243738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6583d13-3b02-4165-aaec-606fd32baa68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:14Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61315af3-6f1a-4e32-a26c-ea77c86962db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61315af3-6f1a-4e32-a26c-ea77c86962db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da3f3ea-ad9c-400e-887e-8d46823620a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da3f3ea-ad9c-400e-887e-8d46823620a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6583d13-3b02-4165-aaec-606fd32baa68', 'volume_name': 'volume-d6583d13-3b02-4165-aaec-606fd32baa68', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954628a-f019-410c-96c0-f6022fe674f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954628a-f019-410c-96c0-f6022fe674f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69599d1c-459d-4956-a687-4c820ee645bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:14 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Volume d6583d13-3b02-4165-aaec-606fd32baa68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6583d13-3b02-4165-aaec-606fd32baa68', 'volume_size': 1}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893243738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6583d13-3b02-4165-aaec-606fd32baa68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:14Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Creating volume d6583d13-3b02-4165-aaec-606fd32baa68 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:18:14 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:18:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:14 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 1073741824
Apr 24 01:18:14 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:15 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 1073741824" returned: 0 in 0.637s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:15 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68
Apr 24 01:18:15 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:15 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68" returned: 0 in 0.504s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69599d1c-459d-4956-a687-4c820ee645bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6583d13-3b02-4165-aaec-606fd32baa68', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c66223-6dcf-4f4b-b06a-62a37cee0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Volume volume-d6583d13-3b02-4165-aaec-606fd32baa68 (d6583d13-3b02-4165-aaec-606fd32baa68): created successfully
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c66223-6dcf-4f4b-b06a-62a37cee0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (7de3dfb0-cba3-48c9-900b-b40d931189f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1eeff28e-046d-4e1e-b50c-38bd7ded167c tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (c5084a5d-27e6-4773-994f-9a8fe9355c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34330e71-e1ba-4035-9ad7-1f0933b8bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34330e71-e1ba-4035-9ad7-1f0933b8bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1204363598',display_name='tempest-VolumesGetTest-Volume-1429882911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0777a959-9b86-408a-9c68-80a096e8682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:17Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f675ef-e6c4-4365-9ae1-e64d96623c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f675ef-e6c4-4365-9ae1-e64d96623c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ba17b7-2d5e-4ef5-bc0c-ed916e30e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ba17b7-2d5e-4ef5-bc0c-ed916e30e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0777a959-9b86-408a-9c68-80a096e8682f', 'volume_name': 'volume-0777a959-9b86-408a-9c68-80a096e8682f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e408318-3cd4-4592-a0e8-e9377636a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e408318-3cd4-4592-a0e8-e9377636a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce26ff96-6123-4278-8b53-9f08cee79c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:17 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Volume 0777a959-9b86-408a-9c68-80a096e8682f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0777a959-9b86-408a-9c68-80a096e8682f', 'volume_size': 1}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1204363598',display_name='tempest-VolumesGetTest-Volume-1429882911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0777a959-9b86-408a-9c68-80a096e8682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:17Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Creating volume 0777a959-9b86-408a-9c68-80a096e8682f {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:18:17 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:17 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f 1073741824
Apr 24 01:18:17 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:17 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f 1073741824" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:17 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f
Apr 24 01:18:17 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:18 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f" returned: 0 in 0.511s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce26ff96-6123-4278-8b53-9f08cee79c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0777a959-9b86-408a-9c68-80a096e8682f', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97514efd-db36-44ff-bcb6-341c2bb7b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:18 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Volume volume-0777a959-9b86-408a-9c68-80a096e8682f (0777a959-9b86-408a-9c68-80a096e8682f): created successfully
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97514efd-db36-44ff-bcb6-341c2bb7b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (c5084a5d-27e6-4773-994f-9a8fe9355c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6194a9c3-edad-4d2e-a711-ce4fb261432a tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:19 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:19 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-0777a959-9b86-408a-9c68-80a096e8682f-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "cinder-0777a959-9b86-408a-9c68-80a096e8682f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-0777a959-9b86-408a-9c68-80a096e8682f" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-0777a959-9b86-408a-9c68-80a096e8682f" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce99836-912d-4287-b2d9-3ccfd3c585d5]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:19 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f
Apr 24 01:18:19 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:19 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.555s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:20 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f" returned: 0 in 0.580s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:20 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f
Apr 24 01:18:20 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:20 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-0777a959-9b86-408a-9c68-80a096e8682f" returned: 0 in 0.465s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-0777a959-9b86-408a-9c68-80a096e8682f" released by "delete_volume" :: held 1.095s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Created reservations ['4099138d-af7a-4048-ae4f-f173c939f546', 'aa8a1067-918b-4734-b4e4-5ff96a7370b7', 'ea862a42-3f77-461f-a2bd-c0e2bfd28b1c', '9f8d8f10-2f53-40e0-903a-6af0adbb9b77'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:20 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:20 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:21 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.474s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:21 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88a04a6c-0fab-4171-a6b1-4b11bda45d06 tempest-VolumesGetTest-473251492 None] Lock "cinder-0777a959-9b86-408a-9c68-80a096e8682f-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-d6583d13-3b02-4165-aaec-606fd32baa68-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "cinder-d6583d13-3b02-4165-aaec-606fd32baa68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-d6583d13-3b02-4165-aaec-606fd32baa68" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-d6583d13-3b02-4165-aaec-606fd32baa68" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc880524-2fab-4f7a-bcab-4e10b5a9954e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:22 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68
Apr 24 01:18:22 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:22 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68" returned: 0 in 0.527s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:22 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68
Apr 24 01:18:22 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:22 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d6583d13-3b02-4165-aaec-606fd32baa68" returned: 0 in 0.464s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-d6583d13-3b02-4165-aaec-606fd32baa68" released by "delete_volume" :: held 1.029s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Created reservations ['bfbb54c4-a8ee-41df-add7-cbd28eb9e10b', '620de1ce-1670-4e47-bea6-cad7d4505a73', 'd22f455c-7d3c-46e7-a836-7369a1f77a8b', 'aa7cd307-ba6b-43e5-b788-ce356ac49627'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:23 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:23 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:23 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:18:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-1f65a958-4136-4bff-83c7-5bae91948c2b tempest-VolumesGetTest-473251492 None] Lock "cinder-d6583d13-3b02-4165-aaec-606fd32baa68-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (6ac8d163-54c4-4a42-8cd7-fd4a41dbcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b99aee-4b35-48e4-a379-cb8942ebe3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b99aee-4b35-48e4-a379-cb8942ebe3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2057588495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f1aeb1-038e-43d8-9366-cb161d50010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:24Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81810ff0-debb-4f96-ab4a-30ea86e70ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81810ff0-debb-4f96-ab4a-30ea86e70ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c4995d-257c-4f9d-8d4d-b622c3575870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c4995d-257c-4f9d-8d4d-b622c3575870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f1aeb1-038e-43d8-9366-cb161d50010e', 'volume_name': 'volume-a6f1aeb1-038e-43d8-9366-cb161d50010e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ac2ed6-da5d-4c7f-848d-396ce33fb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ac2ed6-da5d-4c7f-848d-396ce33fb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b51c5a-eb3b-4132-b0f1-27b66f2056ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:24 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Volume a6f1aeb1-038e-43d8-9366-cb161d50010e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f1aeb1-038e-43d8-9366-cb161d50010e', 'volume_size': 1}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2057588495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f1aeb1-038e-43d8-9366-cb161d50010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:24Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Creating volume a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:18:24 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:18:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:24 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e 1073741824
Apr 24 01:18:24 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:25 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e 1073741824" returned: 0 in 0.664s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:25 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:25 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:25 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.488s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b51c5a-eb3b-4132-b0f1-27b66f2056ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f1aeb1-038e-43d8-9366-cb161d50010e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae3b9a-36a9-431a-856b-9fc770472e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:26 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Volume volume-a6f1aeb1-038e-43d8-9366-cb161d50010e (a6f1aeb1-038e-43d8-9366-cb161d50010e): created successfully
Apr 24 01:18:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae3b9a-36a9-431a-856b-9fc770472e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (6ac8d163-54c4-4a42-8cd7-fd4a41dbcb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:26 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d23a75db-7325-45da-b3ec-e10ab90d7164 tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (2e7dcd98-b5b1-4b29-8d51-67ae72d87a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb12844-6586-4f2f-b93f-2b04790e9de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb12844-6586-4f2f-b93f-2b04790e9de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-771793456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23d1945-5169-47f0-9045-b6195bea6d55,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a6f1aeb1-038e-43d8-9366-cb161d50010e,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:28Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922d12e-255b-4d96-83ba-b2b335fe498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922d12e-255b-4d96-83ba-b2b335fe498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85f226-3f35-4080-9d72-4f85cab4947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85f226-3f35-4080-9d72-4f85cab4947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f23d1945-5169-47f0-9045-b6195bea6d55', 'volume_name': 'volume-f23d1945-5169-47f0-9045-b6195bea6d55', 'volume_size': 1, 'source_volid': 'a6f1aeb1-038e-43d8-9366-cb161d50010e', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f3f9ec-a6f9-4f23-a479-120605d32d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f3f9ec-a6f9-4f23-a479-120605d32d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd25e3-d4e0-4e6a-ba3a-5470c27d2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:27 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Volume f23d1945-5169-47f0-9045-b6195bea6d55: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f23d1945-5169-47f0-9045-b6195bea6d55', 'volume_size': 1, 'source_volid': 'a6f1aeb1-038e-43d8-9366-cb161d50010e', 'source_volstatus': 'available'}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:27 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Cloning volume a6f1aeb1-038e-43d8-9366-cb161d50010e to volume f23d1945-5169-47f0-9045-b6195bea6d55
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Creating offline snapshot 0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e of volume a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c5e4f-f324-4bf7-bf57-b393700ae291]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:27 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:27 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:28 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.560s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:28 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e 1G
Apr 24 01:18:28 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:29 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e 1G" returned: 0 in 0.638s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f1aeb1-038e-43d8-9366-cb161d50010e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:29 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f1aeb1-038e-43d8-9366-cb161d50010e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:29 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:29 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f1aeb1-038e-43d8-9366-cb161d50010e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.504s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:29 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e is being set with open permissions: ugo+rw
Apr 24 01:18:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:29 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:29 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:30 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.474s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:30 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info
Apr 24 01:18:30 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:30 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info" returned: 0 in 0.456s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:30 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info is being set with open permissions: ugo+rw
Apr 24 01:18:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:30 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info
Apr 24 01:18:30 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:30 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.info" returned: 0 in 0.462s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] snapshot: 0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e, volume: f23d1945-5169-47f0-9045-b6195bea6d55,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4246ea-7759-4bb0-9d54-2d2a2c71b46e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:31 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:31 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:31 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.540s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f1aeb1-038e-43d8-9366-cb161d50010e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b23f30-4594-4200-b5cc-c644c408da48]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:31 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:31 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:32 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.568s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:32 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:18:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:32 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55
Apr 24 01:18:32 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:36 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55" returned: 0 in 4.692s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:36 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0a4f9-e8a9-4f05-b8c9-1cb88fa13644]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:36 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:36 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:37 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.670s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:37 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:18:37 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Converted 1024.00 MB image at 218.15 MB/s
Apr 24 01:18:37 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 is being set with open permissions: ugo+rw
Apr 24 01:18:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:37 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55
Apr 24 01:18:37 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:38 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55" returned: 0 in 0.454s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" released by "_copy_volume_from_snapshot" :: held 7.007s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Deleting offline snapshot 0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e of volume a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] snapshot_file for this snap is: volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0024975b-d73e-4850-9e74-15c81cd6ba9c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:38 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:38 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:38 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.546s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f1aeb1-038e-43d8-9366-cb161d50010e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[02296498-d613-476f-a98a-091b6761dc53]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:38 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:38 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:39 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:39 devstack sudo[90037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:39 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:39 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.552s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:39 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e
Apr 24 01:18:39 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=17,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=4 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:18:40 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e.0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" returned: 0 in 0.447s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-0fb9c83a-d37f-4a8a-b20b-1bde5cc9a54e" released by "_delete_snapshot" :: held 2.171s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.459s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd25e3-d4e0-4e6a-ba3a-5470c27d2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23d1945-5169-47f0-9045-b6195bea6d55', 'volume_size': 1, 'source_volid': 'a6f1aeb1-038e-43d8-9366-cb161d50010e', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863873f3-9c03-4be7-b0bd-5fa89b0e0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Volume volume-f23d1945-5169-47f0-9045-b6195bea6d55 (f23d1945-5169-47f0-9045-b6195bea6d55): created successfully
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863873f3-9c03-4be7-b0bd-5fa89b0e0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (2e7dcd98-b5b1-4b29-8d51-67ae72d87a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-03424827-b1d1-46f2-b631-1a7ecd9d7c18 tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (1a0c46f7-ee92-49f6-9681-392f30be6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79895ffc-b7f5-4dec-b278-870766fd3ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79895ffc-b7f5-4dec-b278-870766fd3ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879656210',display_name='tempest-VolumesGetTest-Volume-731998627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005eb872-2de3-4720-b0e3-6e3fc7b7d45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:41Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7bc6e-09c6-4189-a82a-1d3383f01901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7bc6e-09c6-4189-a82a-1d3383f01901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8f6d85-6666-4066-a184-929437145f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8f6d85-6666-4066-a184-929437145f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005eb872-2de3-4720-b0e3-6e3fc7b7d45a', 'volume_name': 'volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846f65d2-30b9-492c-bb74-123218778f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846f65d2-30b9-492c-bb74-123218778f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307aca22-1145-455a-b318-44325b0dd1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Volume 005eb872-2de3-4720-b0e3-6e3fc7b7d45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a', 'volume_size': 1}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879656210',display_name='tempest-VolumesGetTest-Volume-731998627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005eb872-2de3-4720-b0e3-6e3fc7b7d45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:41Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Creating volume 005eb872-2de3-4720-b0e3-6e3fc7b7d45a {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:18:41 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:18:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:41 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a 1073741824
Apr 24 01:18:41 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:42 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a 1073741824" returned: 0 in 0.627s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:42 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a
Apr 24 01:18:42 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:42 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" returned: 0 in 0.485s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307aca22-1145-455a-b318-44325b0dd1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662560c5-6112-480a-abd8-27a5a646b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Volume volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a (005eb872-2de3-4720-b0e3-6e3fc7b7d45a): created successfully
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662560c5-6112-480a-abd8-27a5a646b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (1a0c46f7-ee92-49f6-9681-392f30be6925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-33b12a90-3a6c-4a9f-9f63-3c34eb1d3d89 tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-005eb872-2de3-4720-b0e3-6e3fc7b7d45a-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "cinder-005eb872-2de3-4720-b0e3-6e3fc7b7d45a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b6aae7-6dbb-45cf-bbab-3d4f62b1584a]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:43 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a
Apr 24 01:18:43 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:44 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" returned: 0 in 0.543s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:44 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a
Apr 24 01:18:44 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:44 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" returned: 0 in 0.459s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-005eb872-2de3-4720-b0e3-6e3fc7b7d45a" released by "delete_volume" :: held 1.043s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Created reservations ['0b9739cb-0d2b-4bdb-94d9-9564411c7d83', 'e9647c83-c23c-4be3-988e-0af253c69bc5', '49f374d6-cb13-4d19-806b-fe8769d7a369', '6a1f6f85-9489-4363-b88d-785b62aa3460'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:44 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:44 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:45 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.447s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:45 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-66e9fc81-65bf-4190-906b-f40696158311 tempest-VolumesGetTest-473251492 None] Lock "cinder-005eb872-2de3-4720-b0e3-6e3fc7b7d45a-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-f23d1945-5169-47f0-9045-b6195bea6d55-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "cinder-f23d1945-5169-47f0-9045-b6195bea6d55-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:46 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1d8567-db9f-49c1-abcc-4d97751824a6]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:46 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55
Apr 24 01:18:46 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:46 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55" returned: 0 in 0.568s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:46 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55
Apr 24 01:18:46 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:47 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-f23d1945-5169-47f0-9045-b6195bea6d55" returned: 0 in 0.436s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-f23d1945-5169-47f0-9045-b6195bea6d55" released by "delete_volume" :: held 1.054s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Created reservations ['3c1d55a8-c8a0-4310-a943-20f91b8c49d1', 'c074f513-3168-44a9-9afa-e42d1c66cf81', '05d8f906-8af4-4f28-a7f6-89261ff219ca', '1378619e-f9df-4126-92db-e266cc4e65ca'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:47 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:47 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:47 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.475s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:18:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0fb17996-6555-4ef9-85d5-2e40a288aaf4 tempest-VolumesGetTest-473251492 None] Lock "cinder-f23d1945-5169-47f0-9045-b6195bea6d55-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-a6f1aeb1-038e-43d8-9366-cb161d50010e-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "cinder-a6f1aeb1-038e-43d8-9366-cb161d50010e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-a6f1aeb1-038e-43d8-9366-cb161d50010e" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-a6f1aeb1-038e-43d8-9366-cb161d50010e" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb40e6-ccdb-43b2-8cae-77eb15e03ab6]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:48 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:48 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:48 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.526s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:48 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e
Apr 24 01:18:48 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:49 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a6f1aeb1-038e-43d8-9366-cb161d50010e" returned: 0 in 0.443s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-a6f1aeb1-038e-43d8-9366-cb161d50010e" released by "delete_volume" :: held 1.031s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Created reservations ['416d6a30-e873-4ab0-931b-26f9ab72749a', 'cf2e8d2f-519d-4d2e-aa02-086e3e5172f5', 'f123e2b0-8ee6-4b89-bcf4-0e82c618a658', '141e9dcc-2257-4827-afc0-5ad21618f53f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:49 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:18:49 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:49 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.463s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:18:49 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:18:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d21621be-7496-428b-9cba-dd8bec11c040 tempest-VolumesGetTest-473251492 None] Lock "cinder-a6f1aeb1-038e-43d8-9366-cb161d50010e-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (ef8bb387-ce28-4aeb-9f51-5a10ef0e4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9693df35-f1e8-4fe3-8d13-b1709e0d0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9693df35-f1e8-4fe3-8d13-b1709e0d0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1821406385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4158324f-8369-4131-91ed-678be4d0358c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:51Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7185cbc3-d9e5-4fca-aa52-aa51751a4fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7185cbc3-d9e5-4fca-aa52-aa51751a4fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b709fd-93cf-4d3d-8b88-d75337f6437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.image.glance [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Creating Keystone auth plugin from conf {{(pid=81902) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b709fd-93cf-4d3d-8b88-d75337f6437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4158324f-8369-4131-91ed-678be4d0358c', 'volume_name': 'volume-4158324f-8369-4131-91ed-678be4d0358c', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500b99f0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b380ac9-5cf9-479d-a4dd-918d6770ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b380ac9-5cf9-479d-a4dd-918d6770ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c28aed7-2285-4406-b6eb-09f0444ff2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:51 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Volume 4158324f-8369-4131-91ed-678be4d0358c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4158324f-8369-4131-91ed-678be4d0358c', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500b99f0>}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Trying to clone 4158324f-8369-4131-91ed-678be4d0358c from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]). {{(pid=81902) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 01:18:51 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbebd360-a888-4102-84e6-98a69352cc7f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:52 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD
Apr 24 01:18:52 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:52 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 is fetched for user b56bcaf9197a4678825cb265b0487c41. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bc6c0-f06c-45a7-8dfc-d9eb51c2ebd7]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:52 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD
Apr 24 01:18:52 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:52 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1821406385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4158324f-8369-4131-91ed-678be4d0358c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:51Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Creating volume 4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:18:52 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:18:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:53 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1073741824
Apr 24 01:18:53 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:53 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1073741824" returned: 0 in 0.645s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:53 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:18:53 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:54 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 0 in 0.450s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Attempting download of fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume 4158324f-8369-4131-91ed-678be4d0358c. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae08a939-a6cf-452c-a9ca-e298aed2fee4]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:54 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv
Apr 24 01:18:54 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:54 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv" returned: 0 in 0.489s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:54 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv
Apr 24 01:18:54 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:55 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv" returned: 1 in 0.483s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbaaf1b8-b24b-4256-a358-443af08ba5c6_2jv3wlqv' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b06b41e-36f1-4354-8779-bee1f2f1f065]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:55 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD
Apr 24 01:18:55 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:55 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] fbaaf1b8-b24b-4256-a358-443af08ba5c6 was qcow2, converting to raw {{(pid=81902) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 01:18:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:55 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:18:55 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:57 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 0 in 1.386s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbaaf1b8-b24b-4256-a358-443af08ba5c6_lmnn5k78devstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:18:57 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Converted 112.00 MB image at 80.75 MB/s
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:57 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1G
Apr 24 01:18:57 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:57 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c 1G" returned: 0 in 0.500s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[85af3de2-e547-4cfd-a4bd-8f47a61ec56d]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:18:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:57 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:18:57 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:58 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 0 in 0.522s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:18:58 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:18:58 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:18:58 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 1 in 0.518s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Downloaded image fbaaf1b8-b24b-4256-a358-443af08ba5c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}])) to volume 4158324f-8369-4131-91ed-678be4d0358c successfully. {{(pid=81902) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Temporary image fbaaf1b8-b24b-4256-a358-443af08ba5c6 for user b56bcaf9197a4678825cb265b0487c41 is deleted. {{(pid=81902) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.volume_utils [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Marking volume 4158324f-8369-4131-91ed-678be4d0358c as bootable. {{(pid=81902) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Copying metadata from image fbaaf1b8-b24b-4256-a358-443af08ba5c6 to 4158324f-8369-4131-91ed-678be4d0358c. {{(pid=81902) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Creating volume glance metadata for volume 4158324f-8369-4131-91ed-678be4d0358c backed by image fbaaf1b8-b24b-4256-a358-443af08ba5c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81902) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c28aed7-2285-4406-b6eb-09f0444ff2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4158324f-8369-4131-91ed-678be4d0358c', 'volume_size': 1, 'image_id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95ee46909c3c4cd48cbddb9795234448', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbaaf1b8-b24b-4256-a358-443af08ba5c6', 'created_at': datetime.datetime(2026, 4, 23, 23, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbaaf1b8-b24b-4256-a358-443af08ba5c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbf500b99f0>}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0555a384-73dd-4c16-b939-bb71882c1fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:18:58 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Volume volume-4158324f-8369-4131-91ed-678be4d0358c (4158324f-8369-4131-91ed-678be4d0358c): created successfully
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0555a384-73dd-4c16-b939-bb71882c1fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:18:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (ef8bb387-ce28-4aeb-9f51-5a10ef0e4c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:18:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-49b4d9e1-a4ea-454a-995d-97217548eb6c tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (9232115e-e452-4885-881a-43dbeb56cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c15f8-5351-486a-871d-f67e8dcb4620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c15f8-5351-486a-871d-f67e8dcb4620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1833107032',display_name='tempest-VolumesGetTest-Volume-205341609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5b5202-d8a4-4f98-8001-82dd0bf51f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:00Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3deb6f-366b-4853-92be-f52688185cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3deb6f-366b-4853-92be-f52688185cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32395a92-8641-4010-81ca-c476e92e2a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32395a92-8641-4010-81ca-c476e92e2a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5b5202-d8a4-4f98-8001-82dd0bf51f27', 'volume_name': 'volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ebfab4-6ad4-4932-bbeb-9de024990b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ebfab4-6ad4-4932-bbeb-9de024990b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e822b47-e84b-4aac-ae27-8a725358d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:00 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Volume 1a5b5202-d8a4-4f98-8001-82dd0bf51f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27', 'volume_size': 1}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1833107032',display_name='tempest-VolumesGetTest-Volume-205341609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5b5202-d8a4-4f98-8001-82dd0bf51f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050de129e0be4551a99dc135396d554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:00Z,use_quota=True,user_id='b56bcaf9197a4678825cb265b0487c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Creating volume 1a5b5202-d8a4-4f98-8001-82dd0bf51f27 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:00 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:00 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 1073741824
Apr 24 01:19:00 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:01 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 1073741824" returned: 0 in 0.690s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:01 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27
Apr 24 01:19:01 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:01 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" returned: 0 in 0.474s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e822b47-e84b-4aac-ae27-8a725358d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48caa4e9-e0ec-455b-a2b0-c11de02f4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:01 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Volume volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 (1a5b5202-d8a4-4f98-8001-82dd0bf51f27): created successfully
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48caa4e9-e0ec-455b-a2b0-c11de02f4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:01 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Flow 'volume_create_manager' (9232115e-e452-4885-881a-43dbeb56cbde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:01 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-837dfebb-9bda-4e8a-a3a3-9d6724800004 tempest-VolumesGetTest-473251492 None] Created volume successfully.
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-1a5b5202-d8a4-4f98-8001-82dd0bf51f27-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "cinder-1a5b5202-d8a4-4f98-8001-82dd0bf51f27-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e826b-4f8c-4bc3-bda0-bb8427be3ae9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:02 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27
Apr 24 01:19:02 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:03 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:03 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27
Apr 24 01:19:03 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:03 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-1a5b5202-d8a4-4f98-8001-82dd0bf51f27" released by "delete_volume" :: held 1.058s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Created reservations ['afe51b9e-8734-4776-a185-74ed51cb669f', '1c3334e7-11d1-4bce-bff8-840893d44094', 'b3115457-7f3c-4e9f-b9c2-cc1e1c2067c9', '0ea5b983-390f-4f98-81d1-7651afa96877'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:03 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:03 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:04 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.472s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:04 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:19:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-77d8b673-5d28-403e-b6b1-247a0a793db5 tempest-VolumesGetTest-473251492 None] Lock "cinder-1a5b5202-d8a4-4f98-8001-82dd0bf51f27-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-4158324f-8369-4131-91ed-678be4d0358c-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "cinder-4158324f-8369-4131-91ed-678be4d0358c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Acquiring lock "cinder-quobyte-4158324f-8369-4131-91ed-678be4d0358c" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-4158324f-8369-4131-91ed-678be4d0358c" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0a7de-0f98-40c0-ad42-2a64be561870]: (4, 'raw') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:05 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:19:05 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:05 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 0 in 0.514s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:05 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:19:05 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:06 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 1 in 0.552s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c' failed. Not Retrying. {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:06 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c
Apr 24 01:19:06 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:06 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-4158324f-8369-4131-91ed-678be4d0358c" returned: 0 in 0.458s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "cinder-quobyte-4158324f-8369-4131-91ed-678be4d0358c" released by "delete_volume" :: held 1.591s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Created reservations ['30d78231-ff36-40f7-8ab4-3d6716141bd1', '5ed076cb-4227-4d10-997e-ce68956c8eb7', '20b3c7e0-e4c5-47fe-b9f6-10a8934256a5', '018b6490-6d65-42ef-87cc-ce6c2ec2b620'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:06 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:06 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:07 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.495s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:07 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Deleted volume successfully.
Apr 24 01:19:07 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4b29e8ee-6d2d-42d9-824d-50dce2b4c16d tempest-VolumesGetTest-473251492 None] Lock "cinder-4158324f-8369-4131-91ed-678be4d0358c-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (eebb612b-81cb-4560-99ea-a239f3ca25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73982f1-0a83-4d55-8c5a-bf8cd980fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73982f1-0a83-4d55-8c5a-bf8cd980fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126635929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bfdfd6-ba98-4a17-bc20-c4a701bec6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:12Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc702a4-43e0-4ca9-a201-5f5b8b976d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc702a4-43e0-4ca9-a201-5f5b8b976d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdbdde5-f41f-419e-8e4b-c5e681be926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdbdde5-f41f-419e-8e4b-c5e681be926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83bfdfd6-ba98-4a17-bc20-c4a701bec6cb', 'volume_name': 'volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85842c98-e6e7-4d15-9978-8795c1a3690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85842c98-e6e7-4d15-9978-8795c1a3690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae8eea9-f8c9-445a-ae54-c31d11859fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Volume 83bfdfd6-ba98-4a17-bc20-c4a701bec6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb', 'volume_size': 1}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126635929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bfdfd6-ba98-4a17-bc20-c4a701bec6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:12Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Creating volume 83bfdfd6-ba98-4a17-bc20-c4a701bec6cb {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:12 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:12 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb 1073741824
Apr 24 01:19:12 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (a929498f-96d6-4838-89c4-71aa1bd899c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f4f2bc-e3f9-45ea-a366-4e9303bb646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f4f2bc-e3f9-45ea-a366-4e9303bb646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111744696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:12Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd8d986-298a-4ba1-88c6-a19ae8eb59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd8d986-298a-4ba1-88c6-a19ae8eb59e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c97ba5-360f-46ff-b935-c4487fb74f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c97ba5-360f-46ff-b935-c4487fb74f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a', 'volume_name': 'volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78daa2e-4e7e-4cf8-bbd5-0b80481f37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78daa2e-4e7e-4cf8-bbd5-0b80481f37eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe6f6e8-9cd8-4af5-8032-605b91fa5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Volume e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a', 'volume_size': 1}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (025b3045-2311-4b4e-a36f-41463c05b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ec25f3-6804-4ad6-8f40-a133ec34d153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ec25f3-6804-4ad6-8f40-a133ec34d153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282531525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acf8f0-81d7-4a8a-ae96-c91b67d139d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b8b25-0733-4e09-a8d4-8828b55b6fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b8b25-0733-4e09-a8d4-8828b55b6fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1351df-1797-453f-939b-4279ec82393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1351df-1797-453f-939b-4279ec82393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93acf8f0-81d7-4a8a-ae96-c91b67d139d2', 'volume_name': 'volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d829d9-2e1d-4357-ab47-af6c0f049eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d829d9-2e1d-4357-ab47-af6c0f049eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111fab60-cdf6-4c50-899c-c48b60261269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Volume 93acf8f0-81d7-4a8a-ae96-c91b67d139d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2', 'volume_size': 1}
Apr 24 01:19:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:13 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb 1073741824" returned: 0 in 0.814s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:13 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb
Apr 24 01:19:13 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (0cbe3fc5-1ff0-4599-94bc-cd8f0e0e515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae967aad-3099-4b46-84b6-a5058a551035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae967aad-3099-4b46-84b6-a5058a551035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546238896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdb1654-6366-4f90-9669-294947a9d7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf317363-2a40-423f-b3f0-cd8b7262489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf317363-2a40-423f-b3f0-cd8b7262489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17e02f7-f8fe-45b7-9eb9-3855205ad48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17e02f7-f8fe-45b7-9eb9-3855205ad48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdb1654-6366-4f90-9669-294947a9d7ef', 'volume_name': 'volume-3cdb1654-6366-4f90-9669-294947a9d7ef', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569b831c-a428-4c60-b5ef-91338a636a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569b831c-a428-4c60-b5ef-91338a636a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c3c542-9134-4751-8432-1a44a5234fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Volume 3cdb1654-6366-4f90-9669-294947a9d7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdb1654-6366-4f90-9669-294947a9d7ef', 'volume_size': 1}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (9bea3f97-b338-449a-8a89-6918031b5e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d3d946-521d-494b-87b2-b12e39915ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d3d946-521d-494b-87b2-b12e39915ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607292561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1316eb28-e9d5-45ac-9b20-e089e18c4a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f8c255-ff0a-430b-8f4c-aefc76bf9376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f8c255-ff0a-430b-8f4c-aefc76bf9376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c09bc49-d607-4a8e-9bee-0377233cebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c09bc49-d607-4a8e-9bee-0377233cebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1316eb28-e9d5-45ac-9b20-e089e18c4a58', 'volume_name': 'volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcbf3a2-0bdf-4772-8590-067a48659255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcbf3a2-0bdf-4772-8590-067a48659255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769f6881-c677-4fa7-b3bc-a11a9a7e1c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Volume 1316eb28-e9d5-45ac-9b20-e089e18c4a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58', 'volume_size': 1}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:13 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" returned: 0 in 0.514s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111744696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:12Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Creating volume e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae8eea9-f8c9-445a-ae54-c31d11859fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063b8e24-df39-4545-bd2e-ddcf054938da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:13 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a 1073741824
Apr 24 01:19:13 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Volume volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb (83bfdfd6-ba98-4a17-bc20-c4a701bec6cb): created successfully
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063b8e24-df39-4545-bd2e-ddcf054938da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (eebb612b-81cb-4560-99ea-a239f3ca25b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-50b3ba41-fe8a-498d-a0e7-a3bae35858e8 tempest-CreateVolumesFromImageTest-1935820795 None] Created volume successfully.
Apr 24 01:19:14 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a 1073741824" returned: 0 in 0.644s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:14 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a
Apr 24 01:19:14 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:14 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" returned: 0 in 0.474s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.845s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282531525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acf8f0-81d7-4a8a-ae96-c91b67d139d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Creating volume 93acf8f0-81d7-4a8a-ae96-c91b67d139d2 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:14 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:14 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 1073741824
Apr 24 01:19:14 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe6f6e8-9cd8-4af5-8032-605b91fa5003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890dfb4a-62eb-4c5b-885d-9cccfb434a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:14 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=66,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=26 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:19:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Volume volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a (e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a): created successfully
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890dfb4a-62eb-4c5b-885d-9cccfb434a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (a929498f-96d6-4838-89c4-71aa1bd899c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8fc8c3c8-9168-493b-bf4b-6c5d51714229 tempest-CreateVolumesFromImageTest-1935820795 None] Created volume successfully.
Apr 24 01:19:15 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 1073741824" returned: 0 in 0.646s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:15 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2
Apr 24 01:19:15 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:15 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" returned: 0 in 0.463s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.707s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546238896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdb1654-6366-4f90-9669-294947a9d7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Creating volume 3cdb1654-6366-4f90-9669-294947a9d7ef {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:15 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:15 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef 1073741824
Apr 24 01:19:15 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111fab60-cdf6-4c50-899c-c48b60261269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282c6345-f99e-4c8c-b06b-a5bfbc079f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Volume volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 (93acf8f0-81d7-4a8a-ae96-c91b67d139d2): created successfully
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282c6345-f99e-4c8c-b06b-a5bfbc079f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (025b3045-2311-4b4e-a36f-41463c05b50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8446b9ec-937e-48e3-a518-26244b9605c2 tempest-CreateVolumesFromImageTest-1935820795 None] Created volume successfully.
Apr 24 01:19:16 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef 1073741824" returned: 0 in 0.678s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:16 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef
Apr 24 01:19:16 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:17 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef" returned: 0 in 0.463s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.610s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607292561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1316eb28-e9d5-45ac-9b20-e089e18c4a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596f2a42d600441ea56429488863ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:13Z,use_quota=True,user_id='684fdfad92574440a22946d8e488db3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Creating volume 1316eb28-e9d5-45ac-9b20-e089e18c4a58 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:17 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c3c542-9134-4751-8432-1a44a5234fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdb1654-6366-4f90-9669-294947a9d7ef', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba951ad9-58c3-4834-b573-e89448ea0fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:17 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 1073741824
Apr 24 01:19:17 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:17 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Volume volume-3cdb1654-6366-4f90-9669-294947a9d7ef (3cdb1654-6366-4f90-9669-294947a9d7ef): created successfully
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba951ad9-58c3-4834-b573-e89448ea0fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (0cbe3fc5-1ff0-4599-94bc-cd8f0e0e515d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-293a35d3-c748-43e1-bb7b-05cb924136eb tempest-CreateVolumesFromImageTest-1935820795 None] Created volume successfully.
Apr 24 01:19:17 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 1073741824" returned: 0 in 0.721s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:17 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58
Apr 24 01:19:17 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:18 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58" returned: 0 in 0.445s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769f6881-c677-4fa7-b3bc-a11a9a7e1c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc63c0-ed03-46b8-8059-4af61db431d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:18 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Volume volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 (1316eb28-e9d5-45ac-9b20-e089e18c4a58): created successfully
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc63c0-ed03-46b8-8059-4af61db431d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:18 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Flow 'volume_create_manager' (9bea3f97-b338-449a-8a89-6918031b5e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:18 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-8856a552-bd93-488b-a842-6069440102a3 tempest-CreateVolumesFromImageTest-1935820795 None] Created volume successfully.
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-1316eb28-e9d5-45ac-9b20-e089e18c4a58-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-1316eb28-e9d5-45ac-9b20-e089e18c4a58-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-quobyte-1316eb28-e9d5-45ac-9b20-e089e18c4a58" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-1316eb28-e9d5-45ac-9b20-e089e18c4a58" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40de56-5e37-4515-9bf7-7cfae49aab34]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:19 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58
Apr 24 01:19:19 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:19 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:19 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:19 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58" returned: 0 in 0.543s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:19 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58
Apr 24 01:19:19 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:19 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.479s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:20 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1316eb28-e9d5-45ac-9b20-e089e18c4a58" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-1316eb28-e9d5-45ac-9b20-e089e18c4a58" released by "delete_volume" :: held 1.071s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Created reservations ['063536ae-229e-4c2b-b6a8-66e2837638b3', 'd00ca9eb-38af-4d6a-a9a5-44c7a83b2b13', '835b64e6-7840-4cb9-9c1f-fb98928f51a9', '9af78d7f-9d26-46e9-9a49-44b493d58628'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:20 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:20 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:20 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.443s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:20 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Deleted volume successfully.
Apr 24 01:19:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23d60a80-47f7-4780-9e1d-0bd47681e048 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-1316eb28-e9d5-45ac-9b20-e089e18c4a58-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-3cdb1654-6366-4f90-9669-294947a9d7ef-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-3cdb1654-6366-4f90-9669-294947a9d7ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-quobyte-3cdb1654-6366-4f90-9669-294947a9d7ef" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-3cdb1654-6366-4f90-9669-294947a9d7ef" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[79441487-4437-45fa-aafc-33855d0e147b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:21 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef
Apr 24 01:19:21 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:21 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef" returned: 0 in 0.572s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:21 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:21 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef
Apr 24 01:19:21 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:22 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3cdb1654-6366-4f90-9669-294947a9d7ef" returned: 0 in 0.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-3cdb1654-6366-4f90-9669-294947a9d7ef" released by "delete_volume" :: held 1.120s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Created reservations ['edac3c2c-60d5-47da-846f-63aae38f85b6', '482d6fb1-6c80-44d3-9609-2174b55e0da2', 'a1e835ac-a7f0-44ae-aa73-74061124c541', 'c00e09b5-572f-4858-b2d0-7e6bae78513f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:22 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:22 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:23 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.467s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:23 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Deleted volume successfully.
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4587371c-0fb0-4c2e-94b3-73863c4cd6f1 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-3cdb1654-6366-4f90-9669-294947a9d7ef-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-93acf8f0-81d7-4a8a-ae96-c91b67d139d2-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-93acf8f0-81d7-4a8a-ae96-c91b67d139d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-quobyte-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac25465-aacf-458b-af58-cc07e13d2f04]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:23 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2
Apr 24 01:19:23 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:24 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:24 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2
Apr 24 01:19:24 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:24 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" returned: 0 in 0.488s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-93acf8f0-81d7-4a8a-ae96-c91b67d139d2" released by "delete_volume" :: held 1.087s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Created reservations ['9761cb9e-79e8-4459-8b1d-008f6806d2da', '6f73f10d-ee0d-4f63-983b-f18ec31496ad', '61b7e728-a46d-4fc9-9391-9a6fd2e1a52c', 'afdfd0ba-6bce-40a8-b15e-f874f936048e'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:24 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:24 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:25 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.477s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Deleted volume successfully.
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a2634e62-7c6f-410b-a744-8dadf49aa349 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-93acf8f0-81d7-4a8a-ae96-c91b67d139d2-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-quobyte-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[55adee40-d41a-4ff5-865c-ff47af907ea9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:25 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a
Apr 24 01:19:25 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:26 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" returned: 0 in 0.546s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:26 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a
Apr 24 01:19:26 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:26 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" returned: 0 in 0.457s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a" released by "delete_volume" :: held 1.043s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Created reservations ['49ec56ab-1306-4542-b4ae-2c2486e55d62', '6bbb4a01-d363-4a1d-a39a-dc18ad033223', '856da902-5041-4563-970c-90a0a7fd204a', '54f57242-fa6c-401a-b2e7-c49e921067cb'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:26 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:26 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:27 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:27 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Deleted volume successfully.
Apr 24 01:19:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-664a898d-2e1b-41f4-8d94-b675b45de774 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-e3ccf1a3-b3f9-43f6-9b79-6d152e4d0b1a-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "cinder-quobyte-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da72f1-80fd-4f3f-8b71-ee39fedc8341]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:28 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb
Apr 24 01:19:28 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:28 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" returned: 0 in 0.559s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:28 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb
Apr 24 01:19:28 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:29 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" returned: 0 in 0.495s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-quobyte-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb" released by "delete_volume" :: held 1.094s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Created reservations ['8dd2d896-7897-41eb-be43-0c8753796cee', '0b1d6e83-9672-46fd-b4f8-7550a468940e', '695bb6dd-66c5-4b50-9dcd-b0646ec99fe1', 'e9df4b7a-3420-4129-9959-2bc1b42f4408'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:29 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:29 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:29 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.478s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Deleted volume successfully.
Apr 24 01:19:29 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-0bea898b-c85c-4fbb-b4bc-8b8063ca8547 tempest-CreateVolumesFromImageTest-1935820795 None] Lock "cinder-83bfdfd6-ba98-4a17-bc20-c4a701bec6cb-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (2efa04d1-08ef-4c56-8a37-576b218ffad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d3e35e-4bab-4091-98d0-c9808a60a99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d3e35e-4bab-4091-98d0-c9808a60a99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1192376678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f12d9e-8de6-41de-ad44-2387bd0fb992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:33Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9347f2ae-8521-4763-bd3c-706aee3844a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9347f2ae-8521-4763-bd3c-706aee3844a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1afdef-2781-4b35-b370-855175c7b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1afdef-2781-4b35-b370-855175c7b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f12d9e-8de6-41de-ad44-2387bd0fb992', 'volume_name': 'volume-27f12d9e-8de6-41de-ad44-2387bd0fb992', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36641e-6dc8-4a41-bd36-a1d7da511d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36641e-6dc8-4a41-bd36-a1d7da511d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c14a36-c3cd-4cef-8cc9-5e1d1a702ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:33 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Volume 27f12d9e-8de6-41de-ad44-2387bd0fb992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f12d9e-8de6-41de-ad44-2387bd0fb992', 'volume_size': 1}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1192376678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f12d9e-8de6-41de-ad44-2387bd0fb992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:33Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Creating volume 27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:33 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:33 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 1073741824
Apr 24 01:19:33 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:33 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 1073741824" returned: 0 in 0.680s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:33 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:33 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:34 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.521s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c14a36-c3cd-4cef-8cc9-5e1d1a702ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f12d9e-8de6-41de-ad44-2387bd0fb992', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4280856-ab08-406a-bf0c-9ca1a6d05db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:34 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Volume volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 (27f12d9e-8de6-41de-ad44-2387bd0fb992): created successfully
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4280856-ab08-406a-bf0c-9ca1a6d05db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (2efa04d1-08ef-4c56-8a37-576b218ffad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-dc28e483-b645-4729-b152-e7d624cb3b59 tempest-VolumeDependencyTests-1428030674 None] Created volume successfully.
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Creating offline snapshot bb4c335f-2bc6-4af9-9297-440d436d5982 of volume 27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33860e-854f-4ecc-95a6-227c39bbb9f9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:35 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:35 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:35 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.538s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:35 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 1G
Apr 24 01:19:35 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:36 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 1G" returned: 0 in 0.609s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:36 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:36 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:37 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.503s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:37 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 is being set with open permissions: ugo+rw
Apr 24 01:19:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:37 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:37 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:37 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.454s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:37 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info
Apr 24 01:19:37 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:38 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info" returned: 0 in 0.456s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:38 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info is being set with open permissions: ugo+rw
Apr 24 01:19:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:38 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info
Apr 24 01:19:38 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:38 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.info" returned: 0 in 0.472s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:38 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-abd94e44-da60-4164-b555-bedc24fd525d tempest-VolumeDependencyTests-1428030674 None] Create snapshot completed successfully
Apr 24 01:19:39 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (56673f6d-7d9e-4c14-9c6f-7e4d228e703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d263b6-6f99-4e75-abbc-51119ab0dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d263b6-6f99-4e75-abbc-51119ab0dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120678385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8789d3c2-e269-449e-85a0-c160f271212a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb4c335f-2bc6-4af9-9297-440d436d5982,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:40Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b644cd-de50-4c74-985f-7d78e36a94c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b644cd-de50-4c74-985f-7d78e36a94c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4705e297-5a91-4ed0-b932-604bb5c037c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4705e297-5a91-4ed0-b932-604bb5c037c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8789d3c2-e269-449e-85a0-c160f271212a', 'volume_name': 'volume-8789d3c2-e269-449e-85a0-c160f271212a', 'volume_size': 1, 'snapshot_id': 'bb4c335f-2bc6-4af9-9297-440d436d5982'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a909b2e-bdbc-4e34-b735-9f9c92cef84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a909b2e-bdbc-4e34-b735-9f9c92cef84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2232ee53-8640-4448-bd31-590857df4120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Volume 8789d3c2-e269-449e-85a0-c160f271212a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8789d3c2-e269-449e-85a0-c160f271212a', 'volume_size': 1, 'snapshot_id': 'bb4c335f-2bc6-4af9-9297-440d436d5982'}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982-8789d3c2-e269-449e-85a0-c160f271212a" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982-8789d3c2-e269-449e-85a0-c160f271212a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Creating volume 8789d3c2-e269-449e-85a0-c160f271212a from snapshot bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] snapshot: bb4c335f-2bc6-4af9-9297-440d436d5982, volume: 8789d3c2-e269-449e-85a0-c160f271212a,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=117,cinder:SELECT=91,cinder:DELETE=9,cinder:INSERT=30 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca24bd2-5a59-43ba-8f6c-31ec014b0e25]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:40 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:40 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:40 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.596s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f12d9e-8de6-41de-ad44-2387bd0fb992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a2f001-cc3d-44e6-90c9-3d4a6822e7de]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:40 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:40 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:41 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.544s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:41 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:19:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:41 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a
Apr 24 01:19:41 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:45 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a" returned: 0 in 4.495s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006c0a4-4995-4271-a534-027da88d6a3c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:45 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:45 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:46 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.692s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:46 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:19:46 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Converted 1024.00 MB image at 227.72 MB/s
Apr 24 01:19:46 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a is being set with open permissions: ugo+rw
Apr 24 01:19:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:46 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a
Apr 24 01:19:46 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:46 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a" returned: 0 in 0.441s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" released by "_copy_volume_from_snapshot" :: held 6.917s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982-8789d3c2-e269-449e-85a0-c160f271212a" released by "_create_volume_from_snapshot" :: held 6.957s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.971s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2232ee53-8640-4448-bd31-590857df4120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8789d3c2-e269-449e-85a0-c160f271212a', 'volume_size': 1, 'snapshot_id': 'bb4c335f-2bc6-4af9-9297-440d436d5982'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6c1849-8b7c-47aa-913a-04fd093d075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:47 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Volume volume-8789d3c2-e269-449e-85a0-c160f271212a (8789d3c2-e269-449e-85a0-c160f271212a): created successfully
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6c1849-8b7c-47aa-913a-04fd093d075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (56673f6d-7d9e-4c14-9c6f-7e4d228e703d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e5b681c1-7040-4939-bf4c-ca98e451539f tempest-VolumeDependencyTests-1428030674 None] Created volume successfully.
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-bb4c335f-2bc6-4af9-9297-440d436d5982-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-bb4c335f-2bc6-4af9-9297-440d436d5982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Deleting offline snapshot bb4c335f-2bc6-4af9-9297-440d436d5982 of volume 27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] snapshot_file for this snap is: volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[163eb1f8-4e42-4fe2-9b72-a70d85eeaba4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:47 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:47 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:48 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f12d9e-8de6-41de-ad44-2387bd0fb992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a02090e-b843-4d81-9a76-abf4173eecaa]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:48 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:48 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:48 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:48 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:48 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:49 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.582s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:49 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982
Apr 24 01:19:49 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:49 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992.bb4c335f-2bc6-4af9-9297-440d436d5982" returned: 0 in 0.461s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bb4c335f-2bc6-4af9-9297-440d436d5982" released by "_delete_snapshot" :: held 2.235s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" released by "delete_snapshot" :: held 2.258s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:49 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Created reservations ['80a99b0f-82e0-4a7f-a08c-c16a88334744', '6be2adb1-7485-4052-9f69-d13b9f306720', '07ed5990-4402-49e3-a25e-ec58973d374a', 'c24d8a27-549a-46a7-9d96-76a2a43b4da0'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:50 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Delete snapshot completed successfully.
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-fdb14860-f51e-4b33-983a-c872b1ac6038 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-bb4c335f-2bc6-4af9-9297-440d436d5982-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-27f12d9e-8de6-41de-ad44-2387bd0fb992-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-27f12d9e-8de6-41de-ad44-2387bd0fb992-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159d40f-c082-45ab-819e-76f58056b71b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:51 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:51 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:51 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:51 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992
Apr 24 01:19:51 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:51 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-27f12d9e-8de6-41de-ad44-2387bd0fb992" returned: 0 in 0.470s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-27f12d9e-8de6-41de-ad44-2387bd0fb992" released by "delete_volume" :: held 1.073s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Created reservations ['4375232f-b0c9-48cd-97ea-b56b1d88b003', '8b42dfe2-1d1d-42c8-9f98-5195709a95c3', 'aa25119a-1735-455d-b331-5d402c7da1b6', '1c2516a1-b615-4616-80d3-420d2a784911'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:52 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:19:52 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:52 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.467s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:19:52 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Deleted volume successfully.
Apr 24 01:19:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4fb224be-959f-4eca-9ef6-d3f00897405a tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-27f12d9e-8de6-41de-ad44-2387bd0fb992-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (eb2c4832-aa33-49d7-833b-41ea28d9d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144aee3b-6671-4555-a25e-575331ef1664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144aee3b-6671-4555-a25e-575331ef1664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089655013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:53Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d45ed63-907a-4087-a254-867e804c6e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d45ed63-907a-4087-a254-867e804c6e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80dac1b-5344-41db-9a6f-1eec4931b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80dac1b-5344-41db-9a6f-1eec4931b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'volume_name': 'volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5077b382-4282-4f15-8e36-a0e2b54aa40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5077b382-4282-4f15-8e36-a0e2b54aa40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51f7472-e45f-48b8-bc2c-453810f47019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:53 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Volume 96bcb3c8-827c-46d5-9be9-198ac4ba8d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'volume_size': 1}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089655013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:53Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Creating volume 96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:19:53 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:19:53 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:53 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a 1073741824
Apr 24 01:19:53 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:54 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a 1073741824" returned: 0 in 0.616s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:54 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:19:54 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:54 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.453s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51f7472-e45f-48b8-bc2c-453810f47019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2456ff0-01eb-4ada-843d-69a160610dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:54 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Volume volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a (96bcb3c8-827c-46d5-9be9-198ac4ba8d2a): created successfully
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2456ff0-01eb-4ada-843d-69a160610dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:54 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (eb2c4832-aa33-49d7-833b-41ea28d9d573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:54 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-7e4ba279-7115-4b8b-a440-a8f18ee3ac3a tempest-VolumeDependencyTests-1428030674 None] Created volume successfully.
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (726d81ad-7eff-45ee-aa36-e00921946788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172fcad-0ba5-4632-a82b-d3576f4eb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172fcad-0ba5-4632-a82b-d3576f4eb840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1306735166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471f4547-71b1-4f21-93e4-16fe543809d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03bb0f7b7de4f09bb672c283ade8c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:56Z,use_quota=True,user_id='b3c4b72967634fa598312f9e0f58b6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24648792-bf01-4b37-b61d-9cadc48bf9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24648792-bf01-4b37-b61d-9cadc48bf9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec05e613-308f-43d2-8cc7-5b45374ffbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec05e613-308f-43d2-8cc7-5b45374ffbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '471f4547-71b1-4f21-93e4-16fe543809d3', 'volume_name': 'volume-471f4547-71b1-4f21-93e4-16fe543809d3', 'volume_size': 1, 'source_volid': '96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08995942-d22d-4490-b526-174f706aeb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08995942-d22d-4490-b526-174f706aeb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:19:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6b9cdf-62a8-47dc-a604-5fd1c7471dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:19:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Volume 471f4547-71b1-4f21-93e4-16fe543809d3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-471f4547-71b1-4f21-93e4-16fe543809d3', 'volume_size': 1, 'source_volid': '96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'source_volstatus': 'available'}
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:56 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Cloning volume 96bcb3c8-827c-46d5-9be9-198ac4ba8d2a to volume 471f4547-71b1-4f21-93e4-16fe543809d3
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Creating offline snapshot bcd9b857-b78a-48da-954d-ada08c201f00 of volume 96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cbb175-5caa-4e1c-8538-fe58b39faa08]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:56 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:19:56 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:56 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:56 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 1G
Apr 24 01:19:56 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:57 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 1G" returned: 0 in 0.608s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:57 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:19:57 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:57 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.468s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:57 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 is being set with open permissions: ugo+rw
Apr 24 01:19:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:57 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:19:57 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:58 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.440s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:58 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info
Apr 24 01:19:58 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:58 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info" returned: 0 in 0.439s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:58 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info is being set with open permissions: ugo+rw
Apr 24 01:19:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:58 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info
Apr 24 01:19:58 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:59 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.info" returned: 0 in 0.450s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] snapshot: bcd9b857-b78a-48da-954d-ada08c201f00, volume: 471f4547-71b1-4f21-93e4-16fe543809d3,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c7bb0e-48f9-44b5-b0b5-0a29de92ee33]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:59 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:19:59 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:19:59 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.523s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fdcf15-98a2-4b3d-abc5-6401911cac16]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:19:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:19:59 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:19:59 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:00 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.538s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:00 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:20:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:00 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3
Apr 24 01:20:00 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:05 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3" returned: 0 in 4.880s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c5a6f5-e2eb-4b05-a2e1-50d87626e700]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:05 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:20:05 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:05 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.665s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:20:05 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Converted 1024.00 MB image at 209.77 MB/s
Apr 24 01:20:05 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 is being set with open permissions: ugo+rw
Apr 24 01:20:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:05 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3
Apr 24 01:20:05 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:06 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3" returned: 0 in 0.457s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" released by "_copy_volume_from_snapshot" :: held 7.144s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-bcd9b857-b78a-48da-954d-ada08c201f00" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bcd9b857-b78a-48da-954d-ada08c201f00" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Deleting offline snapshot bcd9b857-b78a-48da-954d-ada08c201f00 of volume 96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] snapshot_file for this snap is: volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8322dbe-eab5-4bb5-9245-a39686f647de]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:06 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:20:06 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:06 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[3786d009-334b-4b7c-b554-bbaf490b7311]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:06 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:20:06 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:07 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.547s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:07 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:20:07 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:07 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.566s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:07 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00
Apr 24 01:20:07 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=22,cinder:SELECT=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:20:08 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a.bcd9b857-b78a-48da-954d-ada08c201f00" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-bcd9b857-b78a-48da-954d-ada08c201f00" released by "_delete_snapshot" :: held 2.229s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.480s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6b9cdf-62a8-47dc-a604-5fd1c7471dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471f4547-71b1-4f21-93e4-16fe543809d3', 'volume_size': 1, 'source_volid': '96bcb3c8-827c-46d5-9be9-198ac4ba8d2a', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ff6ad6-a112-405f-80f2-a1fcbfbfe61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Volume volume-471f4547-71b1-4f21-93e4-16fe543809d3 (471f4547-71b1-4f21-93e4-16fe543809d3): created successfully
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ff6ad6-a112-405f-80f2-a1fcbfbfe61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Flow 'volume_create_manager' (726d81ad-7eff-45ee-aa36-e00921946788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:08 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-619524b1-b16c-496a-a598-5850e75711a2 tempest-VolumeDependencyTests-1428030674 None] Created volume successfully.
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e9c8d-8546-4630-9df8-c3ac10295e1b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:09 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:20:09 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:09 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.555s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:09 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a
Apr 24 01:20:09 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:10 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" returned: 0 in 0.476s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a" released by "delete_volume" :: held 1.091s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Created reservations ['1b3dccea-deda-41af-b177-2e0d9247ca70', '21fe31c2-2242-4bc4-9faa-01ed7c80d330', '664ce6fb-f70a-4cf2-ae6d-68318b1beb51', 'e4f85457-59ea-408a-8882-d7d169ecbc8a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:10 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:10 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:10 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.454s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Deleted volume successfully.
Apr 24 01:20:10 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a502eafb-9a69-4df6-8e2a-737ec99ebe1d tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-96bcb3c8-827c-46d5-9be9-198ac4ba8d2a-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-471f4547-71b1-4f21-93e4-16fe543809d3-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-471f4547-71b1-4f21-93e4-16fe543809d3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bd16ea-5b8f-47aa-83d9-d4fbc03baabf]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:11 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3
Apr 24 01:20:11 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:11 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3" returned: 0 in 0.526s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:11 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3
Apr 24 01:20:11 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:12 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-471f4547-71b1-4f21-93e4-16fe543809d3" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-471f4547-71b1-4f21-93e4-16fe543809d3" released by "delete_volume" :: held 1.051s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Created reservations ['0a663cb4-f9b7-479b-85b5-df17ddec2941', '70a4377e-b687-47ab-96c0-3aeddaf822bd', 'b269863e-e36d-4a05-8ff0-9d3af108ae3d', '5daa4013-9137-4190-a576-5939b8335a23'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:12 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:12 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:12 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.476s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Deleted volume successfully.
Apr 24 01:20:12 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-09aa0fac-70b8-41b5-bf57-09e9daa11487 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-471f4547-71b1-4f21-93e4-16fe543809d3-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-8789d3c2-e269-449e-85a0-c160f271212a-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-8789d3c2-e269-449e-85a0-c160f271212a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead10e3-f8a1-4133-af96-e3c4ac532ee0]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:13 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a
Apr 24 01:20:13 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:14 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:14 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a
Apr 24 01:20:14 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:14 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-8789d3c2-e269-449e-85a0-c160f271212a" returned: 0 in 0.486s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-quobyte-8789d3c2-e269-449e-85a0-c160f271212a" released by "delete_volume" :: held 1.069s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Created reservations ['4ff788f2-28d2-424c-aee4-ad643586b3ff', '6b6144d1-3352-4f95-82b2-283d4938c503', 'd63b69c6-f734-4c38-8461-478f83e73672', 'e8a1921e-ebd3-45e7-9ea2-a1279869e53d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:14 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:14 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:15 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.461s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:15 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Deleted volume successfully.
Apr 24 01:20:15 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=61,cinder:UPDATE=95,cinder:DELETE=11,cinder:INSERT=28 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:20:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-acda4573-ec6a-4a53-a237-e7582db54595 tempest-VolumeDependencyTests-1428030674 None] Lock "cinder-8789d3c2-e269-449e-85a0-c160f271212a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:19 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:19 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:19 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.493s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:19 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:24 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=28,cinder:DELETE=1,cinder:SELECT=17,cinder:INSERT=7 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (d29f5b09-d431-4cd3-9996-1e8ff4f787d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfad3fe-2f87-4465-9e11-824897320730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfad3fe-2f87-4465-9e11-824897320730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675207230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54eb38bb-acc5-4bd3-9427-b5054c93e1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:25Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b0661-ad09-4609-bc4d-1a0e284b7979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b0661-ad09-4609-bc4d-1a0e284b7979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca977dc2-a1bc-438e-b23c-64a288ecc344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca977dc2-a1bc-438e-b23c-64a288ecc344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54eb38bb-acc5-4bd3-9427-b5054c93e1df', 'volume_name': 'volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0777a032-6723-4638-87d4-4ccdebff9e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0777a032-6723-4638-87d4-4ccdebff9e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f59d98-2a80-405e-99bb-19dc3d700276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Volume 54eb38bb-acc5-4bd3-9427-b5054c93e1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df', 'volume_size': 1}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675207230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54eb38bb-acc5-4bd3-9427-b5054c93e1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:25Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Creating volume 54eb38bb-acc5-4bd3-9427-b5054c93e1df {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:25 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:25 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df 1073741824
Apr 24 01:20:25 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (723df851-8128-4bcd-8cb2-fb005d3b5041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba02af98-bf1f-4351-a768-2346f3ed90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba02af98-bf1f-4351-a768-2346f3ed90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144316661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e965f42b-af9b-4734-a5e2-d0c05a6f307d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:25Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe182bab-11dc-42ba-823c-462c720e90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe182bab-11dc-42ba-823c-462c720e90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233661c8-ca0e-452c-96e0-4b902bd810a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233661c8-ca0e-452c-96e0-4b902bd810a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e965f42b-af9b-4734-a5e2-d0c05a6f307d', 'volume_name': 'volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d9f62b-2685-4d1e-bf98-1728761eb145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d9f62b-2685-4d1e-bf98-1728761eb145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34462d6a-f49b-475e-b1d4-71ccdacb8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Volume e965f42b-af9b-4734-a5e2-d0c05a6f307d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d', 'volume_size': 1}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (55b04b1d-9060-4b11-98da-e5977b61d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1429396c-7e18-4592-b1f6-f501000f5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (7123d29c-c104-4b8b-bb77-388e2751b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f9b48c-027e-4b9a-8197-45b3357632a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1429396c-7e18-4592-b1f6-f501000f5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-71880432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e453141-5681-48c6-9d73-ce780810d634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e453141-5681-48c6-9d73-ce780810d634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d78fc3-9a69-4001-8e55-41617aedbe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d78fc3-9a69-4001-8e55-41617aedbe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba', 'volume_name': 'volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1eb55b-a763-4771-acd1-48be1cc193e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1eb55b-a763-4771-acd1-48be1cc193e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c1906e-f2bf-49d2-8dfb-8977a6ef5629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:25 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Volume 7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba', 'volume_size': 1}
Apr 24 01:20:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f9b48c-027e-4b9a-8197-45b3357632a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520967817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbd56ef-dc87-402c-b8f3-05970a103e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f430e-3abe-4ff4-8a14-6fe99739eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f430e-3abe-4ff4-8a14-6fe99739eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6439a6c-043f-473a-b043-162d55bbfcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6439a6c-043f-473a-b043-162d55bbfcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbd56ef-dc87-402c-b8f3-05970a103e87', 'volume_name': 'volume-3dbd56ef-dc87-402c-b8f3-05970a103e87', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38376bb7-85b3-4676-92ca-96eb603d5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38376bb7-85b3-4676-92ca-96eb603d5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9200a782-7ad6-4aaa-a12c-a2942861c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume 3dbd56ef-dc87-402c-b8f3-05970a103e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbd56ef-dc87-402c-b8f3-05970a103e87', 'volume_size': 1}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (9263657a-9103-4d16-ab3c-4e5ae0c3c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66efba74-4eeb-48c7-ae81-7fd3ec1f94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66efba74-4eeb-48c7-ae81-7fd3ec1f94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151315295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208bc513-44b4-4a50-b755-d3d458223497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425fa055-dc7e-4bd2-886d-d378f280de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425fa055-dc7e-4bd2-886d-d378f280de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073be4b9-aaa6-4519-8f30-2e45bd8a8ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073be4b9-aaa6-4519-8f30-2e45bd8a8ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208bc513-44b4-4a50-b755-d3d458223497', 'volume_name': 'volume-208bc513-44b4-4a50-b755-d3d458223497', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed13b84-d7e5-4783-bf6e-c2d4a5b36e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed13b84-d7e5-4783-bf6e-c2d4a5b36e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47db9f2-6905-43cb-9f39-e525bd5804bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Volume 208bc513-44b4-4a50-b755-d3d458223497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208bc513-44b4-4a50-b755-d3d458223497', 'volume_size': 1}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df 1073741824" returned: 0 in 1.026s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:26 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df
Apr 24 01:20:26 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (2c2b14a1-d116-4a3a-a4ab-e3ed032ab901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c8f577-31e3-468f-a3b8-009e7dc3a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c8f577-31e3-468f-a3b8-009e7dc3a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83361629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6ab35a-a0c2-4482-858a-b93eb6a01040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee5c7d8-3350-499a-afcb-d7ade530532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee5c7d8-3350-499a-afcb-d7ade530532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8c77f6-3b61-4fb6-a5f4-5ed0bbe2efa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8c77f6-3b61-4fb6-a5f4-5ed0bbe2efa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6ab35a-a0c2-4482-858a-b93eb6a01040', 'volume_name': 'volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9711fed5-6f88-4469-939d-98e0b16226b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9711fed5-6f88-4469-939d-98e0b16226b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbd5199-502e-47bd-b92d-b1b8b9c0bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Volume bb6ab35a-a0c2-4482-858a-b93eb6a01040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040', 'volume_size': 1}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (643b5152-dee6-48bc-a5b8-813222adf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d0a79f-5aa1-4d86-83c4-838ca3e23c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d0a79f-5aa1-4d86-83c4-838ca3e23c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237019638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94aa96f2-270a-44df-b25c-ab1cb4dda0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:27Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2308fa2-d05b-4faf-b02d-47fdc99c9316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2308fa2-d05b-4faf-b02d-47fdc99c9316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4296157d-9995-4280-b197-c88a97424455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4296157d-9995-4280-b197-c88a97424455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94aa96f2-270a-44df-b25c-ab1cb4dda0bf', 'volume_name': 'volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe6825a-b026-415f-ad5f-d85567a6f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe6825a-b026-415f-ad5f-d85567a6f17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbf234c-fcc7-494f-a4a1-d5ec50db9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:26 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Volume 94aa96f2-270a-44df-b25c-ab1cb4dda0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf', 'volume_size': 1}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df" returned: 0 in 0.776s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144316661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e965f42b-af9b-4734-a5e2-d0c05a6f307d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:25Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Creating volume e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:26 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:27 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d 1073741824
Apr 24 01:20:27 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f59d98-2a80-405e-99bb-19dc3d700276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc94f7a7-bbce-4145-b8f0-5c4ee3a17cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:27 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Volume volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df (54eb38bb-acc5-4bd3-9427-b5054c93e1df): created successfully
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc94f7a7-bbce-4145-b8f0-5c4ee3a17cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (d29f5b09-d431-4cd3-9996-1e8ff4f787d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:27 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e401cd05-3567-46d6-8b06-99de8a59d61d tempest-CreateVolumesFromImageTest-1237126493 None] Created volume successfully.
Apr 24 01:20:27 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d 1073741824" returned: 0 in 0.693s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:27 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:20:27 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:28 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.533s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.277s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-71880432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Creating volume 7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:28 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34462d6a-f49b-475e-b1d4-71ccdacb8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0232fc7-387e-4ae5-8f7d-b2fe793d5f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:28 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba 1073741824
Apr 24 01:20:28 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:28 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Volume volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d (e965f42b-af9b-4734-a5e2-d0c05a6f307d): created successfully
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0232fc7-387e-4ae5-8f7d-b2fe793d5f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:28 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (723df851-8128-4bcd-8cb2-fb005d3b5041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-daaafa7a-270a-442a-80b1-d508c27cbb58 tempest-VolumeDependencyTests-1462755769 None] Created volume successfully.
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:29 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba 1073741824" returned: 0 in 0.789s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:29 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba
Apr 24 01:20:29 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:29 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.591s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520967817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbd56ef-dc87-402c-b8f3-05970a103e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume 3dbd56ef-dc87-402c-b8f3-05970a103e87 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:29 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c1906e-f2bf-49d2-8dfb-8977a6ef5629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b87698-f739-4560-94f5-e570e1d8a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:29 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 1073741824
Apr 24 01:20:29 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:29 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Volume volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba (7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba): created successfully
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b87698-f739-4560-94f5-e570e1d8a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:29 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (55b04b1d-9060-4b11-98da-e5977b61d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:29 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9b811908-00e5-4daa-a285-c36dd7dde631 tempest-CreateVolumesFromImageTest-1237126493 None] Created volume successfully.
Apr 24 01:20:30 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 1073741824" returned: 0 in 0.807s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:30 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87
Apr 24 01:20:30 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:31 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87" returned: 0 in 0.531s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.894s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151315295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208bc513-44b4-4a50-b755-d3d458223497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Creating volume 208bc513-44b4-4a50-b755-d3d458223497 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:31 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9200a782-7ad6-4aaa-a12c-a2942861c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbd56ef-dc87-402c-b8f3-05970a103e87', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f52536-2c79-45af-b203-a1f035253460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:31 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 1073741824
Apr 24 01:20:31 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:31 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 (3dbd56ef-dc87-402c-b8f3-05970a103e87): created successfully
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f52536-2c79-45af-b203-a1f035253460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (7123d29c-c104-4b8b-bb77-388e2751b71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-67dcb59d-3672-4410-9b7c-789adcbca458 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:31 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 1073741824" returned: 0 in 0.736s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:31 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497
Apr 24 01:20:31 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:32 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497" returned: 0 in 0.678s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.037s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83361629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6ab35a-a0c2-4482-858a-b93eb6a01040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:26Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Creating volume bb6ab35a-a0c2-4482-858a-b93eb6a01040 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:32 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:32 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 1073741824
Apr 24 01:20:32 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47db9f2-6905-43cb-9f39-e525bd5804bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208bc513-44b4-4a50-b755-d3d458223497', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72bc095-91b2-4ede-b06b-167564dd132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (ecf0b25a-8d83-4a0a-9689-0ef6dcea7f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60870e4d-d403-4e6c-a348-4fdc3e6f33fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60870e4d-d403-4e6c-a348-4fdc3e6f33fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039943681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf5f66-384a-4089-b143-47d8394994f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:32Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915e8039-a16e-453f-b1ef-37102bf1ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915e8039-a16e-453f-b1ef-37102bf1ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa73b405-56e6-4905-aa1a-60bbfb7ab7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa73b405-56e6-4905-aa1a-60bbfb7ab7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcf5f66-384a-4089-b143-47d8394994f5', 'volume_name': 'volume-3dcf5f66-384a-4089-b143-47d8394994f5', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eab702-746a-4c98-9df5-7e82b5095781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eab702-746a-4c98-9df5-7e82b5095781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a43121-e5ba-4b7c-a831-f1a7f0a4f9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume 3dcf5f66-384a-4089-b143-47d8394994f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcf5f66-384a-4089-b143-47d8394994f5', 'volume_size': 1}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:32 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Volume volume-208bc513-44b4-4a50-b755-d3d458223497 (208bc513-44b4-4a50-b755-d3d458223497): created successfully
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72bc095-91b2-4ede-b06b-167564dd132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (9263657a-9103-4d16-ab3c-4e5ae0c3c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-89e628e2-c96e-457c-af8f-cbe1401898b9 tempest-CreateVolumesFromImageTest-1237126493 None] Created volume successfully.
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (09f44ed4-c8a0-426c-a343-f00849fd55ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6518e7-5bae-4f9c-82db-b19bf8ae59d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6518e7-5bae-4f9c-82db-b19bf8ae59d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613658782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f9c730-854f-400d-8515-9436189323de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:33Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6735de0c-54ee-47b1-b026-56d4dbb6fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6735de0c-54ee-47b1-b026-56d4dbb6fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaebc26-ba52-46c7-8247-51b959e6d014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaebc26-ba52-46c7-8247-51b959e6d014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f9c730-854f-400d-8515-9436189323de', 'volume_name': 'volume-b5f9c730-854f-400d-8515-9436189323de', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be88a127-c60d-4568-8733-795792eddbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be88a127-c60d-4568-8733-795792eddbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edc5d88-f83d-4f11-aad7-95bed03716cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:32 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume b5f9c730-854f-400d-8515-9436189323de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f9c730-854f-400d-8515-9436189323de', 'volume_size': 1}
Apr 24 01:20:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (2ec8afef-7ae5-49b5-a6f5-8525d428cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c43d1d-064d-4ece-8f62-f2c344f7bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c43d1d-064d-4ece-8f62-f2c344f7bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557084736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd90c6cb-ab14-412c-9d94-eae36a32e8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:33Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f403c2-b341-4581-b127-5a30e3292020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f403c2-b341-4581-b127-5a30e3292020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce556686-61f3-4340-b9cf-16b647c0f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce556686-61f3-4340-b9cf-16b647c0f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd90c6cb-ab14-412c-9d94-eae36a32e8fe', 'volume_name': 'volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daf3373-3e8d-473d-b559-6fa308328745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daf3373-3e8d-473d-b559-6fa308328745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f151efef-e501-45e7-b89d-b4b8954e14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume dd90c6cb-ab14-412c-9d94-eae36a32e8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe', 'volume_size': 1}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:33 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 1073741824" returned: 0 in 1.020s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:33 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040
Apr 24 01:20:33 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (d2794ca9-f5cd-4875-8d91-5387f9ef8227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71277122-c5ec-4daf-9ff1-3f7e5825971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71277122-c5ec-4daf-9ff1-3f7e5825971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082352430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af1fe0-c647-4b62-9276-8565fd78c867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:34Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dacf4a5-a8cb-4dd3-b1da-49de152c049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dacf4a5-a8cb-4dd3-b1da-49de152c049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80724510-e31c-4e87-8731-ea7914f2bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80724510-e31c-4e87-8731-ea7914f2bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9af1fe0-c647-4b62-9276-8565fd78c867', 'volume_name': 'volume-a9af1fe0-c647-4b62-9276-8565fd78c867', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa5e84d-c45b-4754-9c83-c26df9aa98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa5e84d-c45b-4754-9c83-c26df9aa98a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8509eef7-05a0-43bc-b668-d41ba009f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:33 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume a9af1fe0-c647-4b62-9276-8565fd78c867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9af1fe0-c647-4b62-9276-8565fd78c867', 'volume_size': 1}
Apr 24 01:20:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (2692778c-eaf1-421b-885d-e9b875063438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea69797-9957-4020-b223-c4c77314784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea69797-9957-4020-b223-c4c77314784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075279935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf72764-01f6-4a92-a74f-b1040c890fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:34Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b970d-dc97-4f19-b161-7e564c758fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b970d-dc97-4f19-b161-7e564c758fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393ad421-167e-4aa1-a14d-c65b0dce912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393ad421-167e-4aa1-a14d-c65b0dce912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf72764-01f6-4a92-a74f-b1040c890fa8', 'volume_name': 'volume-ccf72764-01f6-4a92-a74f-b1040c890fa8', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88a7b66-9988-4d1c-bc64-5db90ee8ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88a7b66-9988-4d1c-bc64-5db90ee8ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a41098-c83d-4a6c-a127-10338f0d92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume ccf72764-01f6-4a92-a74f-b1040c890fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf72764-01f6-4a92-a74f-b1040c890fa8', 'volume_size': 1}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:34 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040" returned: 0 in 0.746s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.510s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237019638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94aa96f2-270a-44df-b25c-ab1cb4dda0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418b9e146cb47358156ade58495e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:27Z,use_quota=True,user_id='dea6f0cd4bf14dd7b8e102ce3ae818e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Creating volume 94aa96f2-270a-44df-b25c-ab1cb4dda0bf {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:34 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbd5199-502e-47bd-b92d-b1b8b9c0bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf 1073741824
Apr 24 01:20:34 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6740347a-17fb-4ade-8da0-4b05584f3814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:34 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Volume volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 (bb6ab35a-a0c2-4482-858a-b93eb6a01040): created successfully
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6740347a-17fb-4ade-8da0-4b05584f3814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:34 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (2c2b14a1-d116-4a3a-a4ab-e3ed032ab901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:34 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4753ed3a-355f-4881-a4b7-49a20b29b1ee tempest-CreateVolumesFromImageTest-1237126493 None] Created volume successfully.
Apr 24 01:20:35 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf 1073741824" returned: 0 in 0.743s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:35 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf
Apr 24 01:20:35 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:35 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" returned: 0 in 0.507s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.606s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbf234c-fcc7-494f-a4a1-d5ec50db9887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ca4a3e-abbe-443e-ab93-e23a7e8a7f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Creating offline snapshot a1e9362e-3a10-49e3-8e76-e4bf8535967c of volume e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:20:35 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Volume volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf (94aa96f2-270a-44df-b25c-ab1cb4dda0bf): created successfully
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ca4a3e-abbe-443e-ab93-e23a7e8a7f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Flow 'volume_create_manager' (643b5152-dee6-48bc-a5b8-813222adf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae387d85-26a9-4247-bd0b-c778c3d6aa8b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:35 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0cf68a9d-dc5d-4c52-af3a-1e3435e84fc3 tempest-CreateVolumesFromImageTest-1237126493 None] Created volume successfully.
Apr 24 01:20:35 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:20:35 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:36 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.627s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:36 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c 1G
Apr 24 01:20:36 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-94aa96f2-270a-44df-b25c-ab1cb4dda0bf-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-94aa96f2-270a-44df-b25c-ab1cb4dda0bf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-quobyte-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e91bae-ffef-432a-a68b-6c16baaae5c4]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:37 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c 1G" returned: 0 in 0.741s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:37 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:37 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:37 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf
Apr 24 01:20:37 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:37 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.691s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:37 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c is being set with open permissions: ugo+rw
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:37 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:37 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:37 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" returned: 0 in 0.785s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:37 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf
Apr 24 01:20:37 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:38 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.479s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:38 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info
Apr 24 01:20:38 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:38 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" returned: 0 in 0.603s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-94aa96f2-270a-44df-b25c-ab1cb4dda0bf" released by "delete_volume" :: held 1.457s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Created reservations ['d0054059-51ed-424b-9d7a-cf3de0401dbe', '0478d4c4-4585-43a7-b583-346e4a964fc5', '4e73d4a1-d44d-4132-9c76-8eb79f431e97', '2e078bcc-d417-4fb8-8791-6addebc33213'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:38 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:38 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:38 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info" returned: 0 in 0.546s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:38 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info is being set with open permissions: ugo+rw
Apr 24 01:20:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:38 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info
Apr 24 01:20:38 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:39 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.612s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Deleted volume successfully.
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-bb6ab35a-a0c2-4482-858a-b93eb6a01040-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-50e834fa-2597-4b8a-8172-3dd81c026205 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-94aa96f2-270a-44df-b25c-ab1cb4dda0bf-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-bb6ab35a-a0c2-4482-858a-b93eb6a01040-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-quobyte-bb6ab35a-a0c2-4482-858a-b93eb6a01040" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-bb6ab35a-a0c2-4482-858a-b93eb6a01040" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:39 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d6ba7c-0faa-42a1-9407-d7f9b3e0a5cd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.info" returned: 0 in 0.577s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.870s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.848s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039943681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf5f66-384a-4089-b143-47d8394994f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:32Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume 3dcf5f66-384a-4089-b143-47d8394994f5 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:39 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:39 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 1073741824
Apr 24 01:20:39 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040
Apr 24 01:20:39 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:39 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-33eef50c-f2bd-4367-a48a-a5bf407e0b59 tempest-VolumeDependencyTests-1462755769 None] Create snapshot completed successfully
Apr 24 01:20:40 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040" returned: 0 in 0.673s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:40 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040
Apr 24 01:20:40 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:40 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 1073741824" returned: 0 in 0.721s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:40 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5
Apr 24 01:20:40 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:40 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bb6ab35a-a0c2-4482-858a-b93eb6a01040" returned: 0 in 0.518s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-bb6ab35a-a0c2-4482-858a-b93eb6a01040" released by "delete_volume" :: held 1.262s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Created reservations ['da9ef918-7800-4798-9e2a-9638a025c345', 'abb5ee6c-140d-4d9e-b852-8be5a8fe264e', 'aae196b6-b0f4-4139-ae4a-c5bded12b755', '21ca65db-8080-409a-82c9-dfb8e07d4483'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:40 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:40 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:40 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.997s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613658782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f9c730-854f-400d-8515-9436189323de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:33Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume b5f9c730-854f-400d-8515-9436189323de {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:40 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:41 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de 1073741824
Apr 24 01:20:41 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a43121-e5ba-4b7c-a831-f1a7f0a4f9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcf5f66-384a-4089-b143-47d8394994f5', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5306f0-814f-47bd-9e2a-08bb54c9450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-3dcf5f66-384a-4089-b143-47d8394994f5 (3dcf5f66-384a-4089-b143-47d8394994f5): created successfully
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5306f0-814f-47bd-9e2a-08bb54c9450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (ecf0b25a-8d83-4a0a-9689-0ef6dcea7f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4183a8a1-f995-45b9-a810-ac6a875ce6eb tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (0cc25082-693a-45c4-980b-d3380a3631e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4b082-804f-4ee0-94c5-0373b6067b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4b082-804f-4ee0-94c5-0373b6067b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-749820753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7c7778-310b-4dd2-ace3-f43e3a3bb347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1e9362e-3a10-49e3-8e76-e4bf8535967c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:41Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7dd4fc-8403-4136-b31e-8e477ff6cf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7dd4fc-8403-4136-b31e-8e477ff6cf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583e6925-0077-4b88-85fc-97629a05d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583e6925-0077-4b88-85fc-97629a05d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea7c7778-310b-4dd2-ace3-f43e3a3bb347', 'volume_name': 'volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347', 'volume_size': 1, 'snapshot_id': 'a1e9362e-3a10-49e3-8e76-e4bf8535967c'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2b201-055b-47a3-a4d0-0f552451e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2b201-055b-47a3-a4d0-0f552451e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26eca1-548b-41f5-9083-6b36c8c66d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:41 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Volume ea7c7778-310b-4dd2-ace3-f43e3a3bb347: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347', 'volume_size': 1, 'snapshot_id': 'a1e9362e-3a10-49e3-8e76-e4bf8535967c'}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:41 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.660s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Deleted volume successfully.
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-eec0c59c-4f2f-422a-9b78-a94016235b6b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-bb6ab35a-a0c2-4482-858a-b93eb6a01040-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-208bc513-44b4-4a50-b755-d3d458223497-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-208bc513-44b4-4a50-b755-d3d458223497-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-quobyte-208bc513-44b4-4a50-b755-d3d458223497" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-208bc513-44b4-4a50-b755-d3d458223497" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1945c408-8293-482e-b168-33b42ee101d8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:41 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de 1073741824" returned: 0 in 0.828s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:41 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497
Apr 24 01:20:41 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:41 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de
Apr 24 01:20:41 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:42 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497" returned: 0 in 0.618s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:42 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de" returned: 0 in 0.590s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.074s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:42 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557084736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd90c6cb-ab14-412c-9d94-eae36a32e8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:33Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:42 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume dd90c6cb-ab14-412c-9d94-eae36a32e8fe {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:42 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edc5d88-f83d-4f11-aad7-95bed03716cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f9c730-854f-400d-8515-9436189323de', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ba1a0a-a87a-47e5-ac1a-308fbdd1c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:42 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe 1073741824
Apr 24 01:20:42 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:42 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-b5f9c730-854f-400d-8515-9436189323de (b5f9c730-854f-400d-8515-9436189323de): created successfully
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ba1a0a-a87a-47e5-ac1a-308fbdd1c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:42 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (09f44ed4-c8a0-426c-a343-f00849fd55ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:42 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9089a231-79ce-42c0-aae8-25d624b4a20f tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:43 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-208bc513-44b4-4a50-b755-d3d458223497" returned: 0 in 0.648s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-208bc513-44b4-4a50-b755-d3d458223497" released by "delete_volume" :: held 1.322s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Created reservations ['aa079e02-51eb-49cc-9f81-a34ad80e0fae', '0fe9ef49-1d6f-4181-9fe6-ad3632898ff7', 'ca3025a0-0253-459c-a7df-c47fc047126a', '93193bba-6f90-4b37-b345-b3a8734024af'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:43 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:43 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:43 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe 1073741824" returned: 0 in 0.933s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:43 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe
Apr 24 01:20:43 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:43 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.767s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:43 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Deleted volume successfully.
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-104f6b6a-4d55-4408-8f3b-4b5b3d2a4459 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-208bc513-44b4-4a50-b755-d3d458223497-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-quobyte-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" acquired by "delete_volume" :: waited 0.023s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3bc28e-af46-42e4-9e44-9bbed19a294c]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:44 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" returned: 0 in 0.711s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.436s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082352430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af1fe0-c647-4b62-9276-8565fd78c867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:34Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume a9af1fe0-c647-4b62-9276-8565fd78c867 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:44 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f151efef-e501-45e7-b89d-b4b8954e14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c607bd9-6266-475c-8444-07118db98a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:44 devstack sudo[90762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 1073741824
Apr 24 01:20:44 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:44 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba
Apr 24 01:20:44 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:44 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe (dd90c6cb-ab14-412c-9d94-eae36a32e8fe): created successfully
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c607bd9-6266-475c-8444-07118db98a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (2ec8afef-7ae5-49b5-a6f5-8525d428cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:44 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-203bba3a-5f3f-40bd-bcad-6723cb7afd00 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:44 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 1073741824" returned: 0 in 0.716s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:44 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" returned: 0 in 0.851s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:44 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867
Apr 24 01:20:45 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:45 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba
Apr 24 01:20:45 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:45 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867" returned: 0 in 0.544s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.221s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075279935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf72764-01f6-4a92-a74f-b1040c890fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7cb9f363a0442c9cd574ee84098fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:34Z,use_quota=True,user_id='d2f729cff6ef4a0395aafce8d7cb105f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Creating volume ccf72764-01f6-4a92-a74f-b1040c890fa8 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:45 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8509eef7-05a0-43bc-b668-d41ba009f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9af1fe0-c647-4b62-9276-8565fd78c867', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:45 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94331b-65cc-4e92-98a1-0a2c1b602e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:45 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 1073741824
Apr 24 01:20:45 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" returned: 0 in 0.588s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:45 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-a9af1fe0-c647-4b62-9276-8565fd78c867 (a9af1fe0-c647-4b62-9276-8565fd78c867): created successfully
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94331b-65cc-4e92-98a1-0a2c1b602e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (d2794ca9-f5cd-4875-8d91-5387f9ef8227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba" released by "delete_volume" :: held 1.518s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:45 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-6987b228-db18-4739-b72e-9d1d96c6b7b4 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Created reservations ['7fe3ee07-2b15-4a27-9b78-465dbe77fd0f', '3fea91d8-f919-4cb1-9116-e4dd2868c714', 'a31db276-966e-4eb7-abd9-68348ef90de1', '845455c8-87de-4b80-9f84-9a343d6ed379'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:45 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:45 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-54eb38bb-acc5-4bd3-9427-b5054c93e1df-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:46 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 1073741824" returned: 0 in 0.823s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-54eb38bb-acc5-4bd3-9427-b5054c93e1df-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "cinder-quobyte-54eb38bb-acc5-4bd3-9427-b5054c93e1df" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-54eb38bb-acc5-4bd3-9427-b5054c93e1df" acquired by "delete_volume" :: waited 0.049s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:46 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8
Apr 24 01:20:46 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a95ff7-ec29-4d40-9a49-d572e3e98a20]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:46 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.792s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:46 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Deleted volume successfully.
Apr 24 01:20:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddb8e990-6024-43c7-a3f1-56145cde9b3b tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-7f1a9f75-2a6c-47bc-bfd5-a95362ad3bba-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:46 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df
Apr 24 01:20:46 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:47 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8" returned: 0 in 0.610s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.598s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a41098-c83d-4a6c-a127-10338f0d92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf72764-01f6-4a92-a74f-b1040c890fa8', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab9e845-7e34-4442-a453-592e4a3d3077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Creating volume ea7c7778-310b-4dd2-ace3-f43e3a3bb347 from snapshot a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:47 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Volume volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 (ccf72764-01f6-4a92-a74f-b1040c890fa8): created successfully
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab9e845-7e34-4442-a453-592e4a3d3077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Flow 'volume_create_manager' (2692778c-eaf1-421b-885d-e9b875063438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] snapshot: a1e9362e-3a10-49e3-8e76-e4bf8535967c, volume: ea7c7778-310b-4dd2-ace3-f43e3a3bb347,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:20:47 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5c822c23-6eef-4992-9a35-acbde2d1a746 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created volume successfully.
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[51086ba8-2a9c-4a94-a4c9-bedb05001397]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:47 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df" returned: 0 in 0.738s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:47 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df
Apr 24 01:20:47 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:47 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:47 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-ccf72764-01f6-4a92-a74f-b1040c890fa8-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-ccf72764-01f6-4a92-a74f-b1040c890fa8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-ccf72764-01f6-4a92-a74f-b1040c890fa8" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:47 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-ccf72764-01f6-4a92-a74f-b1040c890fa8" acquired by "delete_volume" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-54eb38bb-acc5-4bd3-9427-b5054c93e1df" returned: 0 in 0.588s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79321ef-a604-41b5-a179-416bd1b19cbd]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-quobyte-54eb38bb-acc5-4bd3-9427-b5054c93e1df" released by "delete_volume" :: held 1.400s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:47 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.679s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4df696-2fba-46a4-9ef6-586ec88a640e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:47 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Created reservations ['2b46af72-2ffb-4341-8c7d-671054ec3368', 'd2f81a89-c1c1-4569-ac03-233defa5ec21', '8fb3f431-0e2b-46ef-87d5-32dda4fb920a', '4f3920a7-1a8b-4250-b513-e7cfa1f2d142'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:47 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8
Apr 24 01:20:47 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:48 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:20:48 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:48 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:48 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:48 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:48 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Deleted volume successfully.
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8" returned: 0 in 0.781s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9a9a0168-c15b-49c2-b38a-68209732a7f8 tempest-CreateVolumesFromImageTest-1237126493 None] Lock "cinder-54eb38bb-acc5-4bd3-9427-b5054c93e1df-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:48 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8
Apr 24 01:20:48 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:48 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.854s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:20:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:48 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347
Apr 24 01:20:48 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:49 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ccf72764-01f6-4a92-a74f-b1040c890fa8" returned: 0 in 0.701s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-ccf72764-01f6-4a92-a74f-b1040c890fa8" released by "delete_volume" :: held 1.545s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['b1419e74-6ca3-4040-b60c-6f4ab1d3f995', 'dcce86cd-0ef9-48d2-badf-6fb51d0b5578', 'bf0b1fd2-aba8-4ab5-ba9f-f9f522a511f5', '1c7f2078-2d41-47e5-b1d7-8b86e0139fd4'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:49 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:49 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-a9af1fe0-c647-4b62-9276-8565fd78c867-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-a9af1fe0-c647-4b62-9276-8565fd78c867-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-a9af1fe0-c647-4b62-9276-8565fd78c867" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-a9af1fe0-c647-4b62-9276-8565fd78c867" acquired by "delete_volume" :: waited 0.050s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f619bf-3919-4aee-b8fb-26ad11b952ce]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:50 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867
Apr 24 01:20:50 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:51 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.666s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:51 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:51 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:20:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-ddc87a0b-4407-49a0-84d8-fdc9edff89e7 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-ccf72764-01f6-4a92-a74f-b1040c890fa8-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:52 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867" returned: 0 in 2.300s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:52 devstack sudo[90840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867
Apr 24 01:20:52 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:54 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:54 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-a9af1fe0-c647-4b62-9276-8565fd78c867" returned: 0 in 1.761s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:54 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-a9af1fe0-c647-4b62-9276-8565fd78c867" released by "delete_volume" :: held 4.164s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:54 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['fab93ad1-216f-40a5-a46c-ee3f5c278501', '25bd1cfa-d712-4885-ae7f-222e6b492cfc', 'f81316f3-53df-4e26-bcf5-0d0e51545e69', '769b5f97-7148-460a-b21a-5beafb323ccf'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (f24236e7-6461-4976-85a7-a3bc3102d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92542b53-9a29-463e-a398-4449d691c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92542b53-9a29-463e-a398-4449d691c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620510708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e217ce-c638-4b38-8e77-2522e92a12db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:55Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbd6a26-6cd0-4a95-af8e-501eb42f4e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbd6a26-6cd0-4a95-af8e-501eb42f4e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41c5697-8d30-4cfc-b6c6-0e42c99088c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41c5697-8d30-4cfc-b6c6-0e42c99088c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e217ce-c638-4b38-8e77-2522e92a12db', 'volume_name': 'volume-c7e217ce-c638-4b38-8e77-2522e92a12db', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6f0cbc-92db-459c-b603-1afdf607986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6f0cbc-92db-459c-b603-1afdf607986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36365207-c544-4b6c-84c4-47543d906b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume c7e217ce-c638-4b38-8e77-2522e92a12db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e217ce-c638-4b38-8e77-2522e92a12db', 'volume_size': 1}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:55 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:55 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Flow 'volume_create_manager' (138658d3-f280-4506-80fe-95fa1fd1622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ec07-d0ae-481b-9ded-d3a5d9b553d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ec07-d0ae-481b-9ded-d3a5d9b553d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-985522147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dd72c7-c061-49fb-b831-51de622540f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a359ad0de94d79a17484b63baf2571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:55Z,use_quota=True,user_id='0e0bcea37c704c3bbd9eda5ac38260e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b91a79-6364-4d2e-927b-c92e9bbfcf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b91a79-6364-4d2e-927b-c92e9bbfcf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad98d011-5aa9-4501-8504-6671a3a5e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad98d011-5aa9-4501-8504-6671a3a5e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3dd72c7-c061-49fb-b831-51de622540f1', 'volume_name': 'volume-e3dd72c7-c061-49fb-b831-51de622540f1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5b010-26be-43e5-be97-ef1cde51ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5b010-26be-43e5-be97-ef1cde51ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfb5f54-9e9b-44c4-bbae-20bd1b8c43d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:55 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Volume e3dd72c7-c061-49fb-b831-51de622540f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3dd72c7-c061-49fb-b831-51de622540f1', 'volume_size': 1}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:55 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" returned: 0 in 6.860s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a2ea9-c339-461d-857a-0b1a71561643]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:55 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:20:55 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:55 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-dd90c6cb-ab14-412c-9d94-eae36a32e8fe-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.640s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:55 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-dd90c6cb-ab14-412c-9d94-eae36a32e8fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:55 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-494c280e-00ec-4030-b45f-8e634182fa43 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-a9af1fe0-c647-4b62-9276-8565fd78c867-delete_volume" released by "delete_volume" :: held 5.737s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" acquired by "delete_volume" :: waited 0.013s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[61accd53-94b3-4ca0-8715-7b3a9157f3d3]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:56 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe
Apr 24 01:20:56 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:56 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.700s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:20:56 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Converted 1024.00 MB image at 149.25 MB/s
Apr 24 01:20:56 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 is being set with open permissions: ugo+rw
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:56 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347
Apr 24 01:20:56 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:56 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" returned: 0 in 0.576s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:56 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe
Apr 24 01:20:56 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:56 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" returned: 0 in 0.447s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" released by "_copy_volume_from_snapshot" :: held 9.673s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" released by "_create_volume_from_snapshot" :: held 9.740s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.779s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620510708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e217ce-c638-4b38-8e77-2522e92a12db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:55Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:56 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:56 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db 1073741824
Apr 24 01:20:56 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26eca1-548b-41f5-9083-6b36c8c66d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347', 'volume_size': 1, 'snapshot_id': 'a1e9362e-3a10-49e3-8e76-e4bf8535967c'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04fe360-dab3-4eb6-983c-098c3e56dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:56 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Volume volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 (ea7c7778-310b-4dd2-ace3-f43e3a3bb347): created successfully
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04fe360-dab3-4eb6-983c-098c3e56dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:56 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (0cc25082-693a-45c4-980b-d3380a3631e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:56 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-352fa9cb-1d28-4402-9982-024d2a9be0cb tempest-VolumeDependencyTests-1462755769 None] Created volume successfully.
Apr 24 01:20:57 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" returned: 0 in 0.453s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-dd90c6cb-ab14-412c-9d94-eae36a32e8fe" released by "delete_volume" :: held 1.070s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['7bb138c9-3887-4f72-af8c-2f629d8264bc', '031b2cd4-b03a-4ec0-b21c-379d26d9199d', 'e66177c3-2529-4335-9288-3e26a10a7b52', '08698da0-e7d0-4927-9d42-834db081150f'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-a1e9362e-3a10-49e3-8e76-e4bf8535967c-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:57 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-a1e9362e-3a10-49e3-8e76-e4bf8535967c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:57 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Deleting offline snapshot a1e9362e-3a10-49e3-8e76-e4bf8535967c of volume e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] snapshot_file for this snap is: volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce40b00-0aba-4920-9d8d-32739fa25936]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:57 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:57 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:57 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db 1073741824" returned: 0 in 0.752s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:57 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db
Apr 24 01:20:57 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:57 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.543s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:20:57 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-b16f9932-2bc5-4a69-8108-d9ccec4d4a75 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-dd90c6cb-ab14-412c-9d94-eae36a32e8fe-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:57 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.574s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b412b907-2db7-4593-b599-42b8af090c49]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:57 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:58 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:20:58 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:58 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-985522147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dd72c7-c061-49fb-b831-51de622540f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a359ad0de94d79a17484b63baf2571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:55Z,use_quota=True,user_id='0e0bcea37c704c3bbd9eda5ac38260e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Creating volume e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:20:58 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-b5f9c730-854f-400d-8515-9436189323de-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36365207-c544-4b6c-84c4-47543d906b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e217ce-c638-4b38-8e77-2522e92a12db', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceada871-5a84-4433-aec5-95a549281349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-b5f9c730-854f-400d-8515-9436189323de-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:58 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-c7e217ce-c638-4b38-8e77-2522e92a12db (c7e217ce-c638-4b38-8e77-2522e92a12db): created successfully
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceada871-5a84-4433-aec5-95a549281349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (f24236e7-6461-4976-85a7-a3bc3102d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:58 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 1073741824
Apr 24 01:20:58 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:58 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e362aa5d-b490-4f12-aada-08372b91ff19 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-b5f9c730-854f-400d-8515-9436189323de" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-b5f9c730-854f-400d-8515-9436189323de" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86a3d3-5554-459c-ae1b-c676e30fd869]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:58 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de
Apr 24 01:20:58 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:58 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.768s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:58 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:58 devstack sudo[90887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:58 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 1073741824" returned: 0 in 0.875s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:59 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de" returned: 0 in 0.717s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:59 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:20:59 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de
Apr 24 01:20:59 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.650s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:59 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c
Apr 24 01:20:59 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.527s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.885s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfb5f54-9e9b-44c4-bbae-20bd1b8c43d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dd72c7-c061-49fb-b831-51de622540f1', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:59 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a76c8d-110d-4984-810b-902f7067f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b5f9c730-854f-400d-8515-9436189323de" returned: 0 in 0.563s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Volume volume-e3dd72c7-c061-49fb-b831-51de622540f1 (e3dd72c7-c061-49fb-b831-51de622540f1): created successfully
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a76c8d-110d-4984-810b-902f7067f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Flow 'volume_create_manager' (138658d3-f280-4506-80fe-95fa1fd1622e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating offline snapshot 258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 of volume c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-b5f9c730-854f-400d-8515-9436189323de" released by "delete_volume" :: held 1.365s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c09471-6854-4c70-8075-fd9e54e547eb]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:59 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2503176a-7772-4d2e-a235-6da4a9c4a518 tempest-SnapshotDependencyTests-802038019 None] Created volume successfully.
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['870c9700-d875-42e8-969c-91f6d2ec559d', '4a512494-e1bf-410a-a790-5e0fd3c2ff20', 'e8ee63df-0a57-4d12-b141-5ff780658757', 'd9bfda82-cb02-4d2e-83d4-b00a24e24329'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:20:59 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db
Apr 24 01:20:59 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:20:59 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d.a1e9362e-3a10-49e3-8e76-e4bf8535967c" returned: 0 in 0.482s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:20:59 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:20:59 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-a1e9362e-3a10-49e3-8e76-e4bf8535967c" released by "_delete_snapshot" :: held 2.578s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" released by "delete_snapshot" :: held 2.602s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:20:59 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Created reservations ['ffc2515f-113e-44da-bae9-b357ddddd396', '940a6de5-b74e-4d14-a223-ea1a67a91d4f', 'ef6f9038-3304-4405-90d2-133cf7d7edd0', 'ed89d4dc-0591-4101-8b08-4d8afcb49d99'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Delete snapshot completed successfully.
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4dfc400e-1859-4977-abf7-d31adf7a5040 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-a1e9362e-3a10-49e3-8e76-e4bf8535967c-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:00 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db" returned: 0 in 0.592s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:00 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 1G
Apr 24 01:21:00 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:00 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.506s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:00 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-4cb2ad94-7240-43bd-beb9-8f6733bef5aa tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-b5f9c730-854f-400d-8515-9436189323de-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-3dcf5f66-384a-4089-b143-47d8394994f5-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-3dcf5f66-384a-4089-b143-47d8394994f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-e965f42b-af9b-4734-a5e2-d0c05a6f307d-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-e965f42b-af9b-4734-a5e2-d0c05a6f307d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-3dcf5f66-384a-4089-b143-47d8394994f5" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-3dcf5f66-384a-4089-b143-47d8394994f5" acquired by "delete_volume" :: waited 0.029s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4afb58-6c82-4ccf-8413-fe55b37a0f84]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a542f39f-bd2f-4abe-8877-6de7377f7630]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:00 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:00 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5
Apr 24 01:21:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:00 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:21:00 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:01 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 1G" returned: 0 in 0.794s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e217ce-c638-4b38-8e77-2522e92a12db -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:01 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e217ce-c638-4b38-8e77-2522e92a12db -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958
Apr 24 01:21:01 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:01 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5" returned: 0 in 0.654s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:01 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5
Apr 24 01:21:01 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:01 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.669s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:01 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d
Apr 24 01:21:01 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:01 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e217ce-c638-4b38-8e77-2522e92a12db -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" returned: 0 in 0.597s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 is being set with open permissions: ugo+rw
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:01 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958
Apr 24 01:21:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:01 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dcf5f66-384a-4089-b143-47d8394994f5" returned: 0 in 0.555s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-3dcf5f66-384a-4089-b143-47d8394994f5" released by "delete_volume" :: held 1.256s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['f7e2e203-02c0-4af6-88a2-96232c0fa0cb', '2f268838-6fb1-4100-807e-3a9e0b517fb3', '446f34c2-ebf9-4bdd-9383-bfa98780f7cc', '35de10f4-0fd4-4ee5-9615-6e9a328dba72'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:01 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e965f42b-af9b-4734-a5e2-d0c05a6f307d" returned: 0 in 0.609s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:01 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-e965f42b-af9b-4734-a5e2-d0c05a6f307d" released by "delete_volume" :: held 1.370s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:01 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:01 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Created reservations ['60226200-7f51-4047-9422-8222d72bbefe', 'a7bc2ce0-7383-430a-9cd2-2216719df4a2', 'beb0e6b2-43d1-46f0-a118-f72b47b3577d', '67846436-018b-4523-bd40-ed61901bc098'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:02 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:02 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:02 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" returned: 0 in 0.550s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:02 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info
Apr 24 01:21:02 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:02 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.528s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-3d5c0628-f1c9-413a-8ffe-544d10a535dc tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-3dcf5f66-384a-4089-b143-47d8394994f5-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:02 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.560s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:02 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Deleted volume successfully.
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-26604166-0902-46ee-93f3-d02ef9f0c296 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-e965f42b-af9b-4734-a5e2-d0c05a6f307d-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-3dbd56ef-dc87-402c-b8f3-05970a103e87-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-3dbd56ef-dc87-402c-b8f3-05970a103e87-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "cinder-quobyte-3dbd56ef-dc87-402c-b8f3-05970a103e87" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-3dbd56ef-dc87-402c-b8f3-05970a103e87" acquired by "delete_volume" :: waited 0.038s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba0d85-5be8-427e-bf03-e665d7f7c863]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:02 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info" returned: 0 in 0.710s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:02 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info is being set with open permissions: ugo+rw
Apr 24 01:21:02 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:02 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87
Apr 24 01:21:02 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:02 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info
Apr 24 01:21:02 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (3ccb9931-5876-4cc4-b13c-7f4722f29c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf94b5-bc16-41c8-bd0f-44f0ff7a955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf94b5-bc16-41c8-bd0f-44f0ff7a955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-461599586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4c9bbc-c23b-40f9-bc28-716203695d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:03Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8d8965-3eb3-4ac7-b120-98c97e2d5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8d8965-3eb3-4ac7-b120-98c97e2d5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dee634-26d1-4d14-bbf5-fe6e2df92162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dee634-26d1-4d14-bbf5-fe6e2df92162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'volume_name': 'volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dbd4e5-2c19-4492-9f78-5150da79e6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dbd4e5-2c19-4492-9f78-5150da79e6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf2795-d7e5-4e3f-97b4-79c20cdbf6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:03 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Volume 5e4c9bbc-c23b-40f9-bc28-716203695d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'volume_size': 1}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:03 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87" returned: 0 in 0.624s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:03 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.info" returned: 0 in 0.551s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:03 devstack sudo[90963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87
Apr 24 01:21:03 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.954s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.462s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Creating offline snapshot f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 of volume e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:21:03 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e11836ac-c853-4504-b513-41ea69060cf1 tempest-CreateVolumesFromSnapshotTest-297963774 None] Create snapshot completed successfully
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bacc0c-c4be-4853-a9fc-df8135b4dfe9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:03 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:03 devstack sudo[90965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:03 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:04 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3dbd56ef-dc87-402c-b8f3-05970a103e87" returned: 0 in 0.532s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-quobyte-3dbd56ef-dc87-402c-b8f3-05970a103e87" released by "delete_volume" :: held 1.220s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Created reservations ['d830bd6f-281a-4d98-9627-c5597fae1408', '536bf1d9-a83e-4525-94ea-d39d5b139714', '7c606b92-8f86-4298-93c0-35b65def8e64', '5d1a04ed-5b88-4c0e-bd45-74238150f288'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:04 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:04 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:04 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.753s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:04 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 1G
Apr 24 01:21:04 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (3a81a091-53ca-4763-a146-83ec7265e9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f5cb0-7664-4655-8a7f-4aba15eaeb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f5cb0-7664-4655-8a7f-4aba15eaeb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322833953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987a3aa-4219-4915-8c28-9f89f02d0faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:04Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1571c32f-bcb4-47bf-a402-2e756a049591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1571c32f-bcb4-47bf-a402-2e756a049591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab3ced8-9f7a-414f-ba09-52c16ce65824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab3ced8-9f7a-414f-ba09-52c16ce65824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd987a3aa-4219-4915-8c28-9f89f02d0faa', 'volume_name': 'volume-d987a3aa-4219-4915-8c28-9f89f02d0faa', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c331ccf-f1d8-4cf7-81b6-bd893e8822a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c331ccf-f1d8-4cf7-81b6-bd893e8822a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcfef5b-7d1d-43e6-a01c-90241729fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume d987a3aa-4219-4915-8c28-9f89f02d0faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d987a3aa-4219-4915-8c28-9f89f02d0faa', 'volume_size': 1}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (b2d83d8f-8b3a-4609-bf78-4f043ea7c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78fbcb3-39bb-4998-a000-66ed1c2d2c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78fbcb3-39bb-4998-a000-66ed1c2d2c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136324904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0caae76-8ed4-464d-8e2f-48afc2c12519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74166a30-dc85-4e5e-8257-b850c8aac46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74166a30-dc85-4e5e-8257-b850c8aac46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb7a24-fd30-4538-ade2-ab0a47753faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb7a24-fd30-4538-ade2-ab0a47753faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0caae76-8ed4-464d-8e2f-48afc2c12519', 'volume_name': 'volume-e0caae76-8ed4-464d-8e2f-48afc2c12519', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d196bcc-3b0e-437f-8ca8-cea3ff4fbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d196bcc-3b0e-437f-8ca8-cea3ff4fbca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcbfd73-67cd-49f9-9aa0-7e75e4592534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:04 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume e0caae76-8ed4-464d-8e2f-48afc2c12519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0caae76-8ed4-464d-8e2f-48afc2c12519', 'volume_size': 1}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.557s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:04 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Deleted volume successfully.
Apr 24 01:21:04 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-39bde11c-b790-4554-b016-f1920675add9 tempest-CreateVolumesFromSourceVolumeTest-417575415 None] Lock "cinder-3dbd56ef-dc87-402c-b8f3-05970a103e87-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (16be7c4c-3db6-40f5-bfbb-29711b990502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0fbd3-64e9-4274-b154-c4dc16ac44dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0fbd3-64e9-4274-b154-c4dc16ac44dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69600922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b731ce0d-47ef-4c52-82ef-20f788284d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95835e-7d5f-45d1-a974-39a3b1f80ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95835e-7d5f-45d1-a974-39a3b1f80ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c5a3b4-983d-4031-bdbc-3f544f8dc5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c5a3b4-983d-4031-bdbc-3f544f8dc5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b731ce0d-47ef-4c52-82ef-20f788284d19', 'volume_name': 'volume-b731ce0d-47ef-4c52-82ef-20f788284d19', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45475c9-7128-47f5-8db5-8a7f50a2c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45475c9-7128-47f5-8db5-8a7f50a2c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5141135d-ea67-4d1d-854f-72d2858a6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume b731ce0d-47ef-4c52-82ef-20f788284d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b731ce0d-47ef-4c52-82ef-20f788284d19', 'volume_size': 1}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 1G" returned: 0 in 0.960s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dd72c7-c061-49fb-b831-51de622540f1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:05 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dd72c7-c061-49fb-b831-51de622540f1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:05 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (3d2619d2-9506-4770-b99f-4e32f60484dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a3c387-981a-4ac5-8ae1-b11260161a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a3c387-981a-4ac5-8ae1-b11260161a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480509787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae93ddb-e5cc-4901-a0ec-d915c7424f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a4c7c7-ebd3-4e28-86a2-ba4e538b50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a4c7c7-ebd3-4e28-86a2-ba4e538b50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e37fb9-b1ad-404a-b8ec-efa6a6021ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e37fb9-b1ad-404a-b8ec-efa6a6021ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae93ddb-e5cc-4901-a0ec-d915c7424f46', 'volume_name': 'volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be4fa2-5918-40c9-8b2e-b5a8f89157ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be4fa2-5918-40c9-8b2e-b5a8f89157ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18653d0a-bfe0-4d80-afbe-211e807aa242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume 5ae93ddb-e5cc-4901-a0ec-d915c7424f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46', 'volume_size': 1}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (0375ec81-206b-4d05-ba03-ed0e88fd4d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf85ac0-8a05-43a3-a320-abbf305648b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf85ac0-8a05-43a3-a320-abbf305648b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841675276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8278061-6ffb-4aa3-be25-de8119e6573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8278061-6ffb-4aa3-be25-de8119e6573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ea5ba2-e1b5-4607-a14c-b20801de1045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ea5ba2-e1b5-4607-a14c-b20801de1045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3', 'volume_name': 'volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:05 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b25975-ca68-456e-9934-2028988114db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:05 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b25975-ca68-456e-9934-2028988114db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bfc425-4dce-48f2-b86d-d11e6486e977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:06 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume 1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3', 'volume_size': 1}
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dd72c7-c061-49fb-b831-51de622540f1 -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.683s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:06 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 is being set with open permissions: ugo+rw
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:06 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:06 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:06 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.562s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:06 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:06 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info
Apr 24 01:21:06 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:07 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info" returned: 0 in 0.519s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:07 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info is being set with open permissions: ugo+rw
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:07 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info
Apr 24 01:21:07 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:07 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.info" returned: 0 in 0.547s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.501s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-461599586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4c9bbc-c23b-40f9-bc28-716203695d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:03Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Creating volume 5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:07 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:07 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:07 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e 1073741824
Apr 24 01:21:07 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:07 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5bcc7d56-c420-4aea-ab70-df554c951183 tempest-SnapshotDependencyTests-802038019 None] Create snapshot completed successfully
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Flow 'volume_create_manager' (db3e8d2c-1a78-4a58-8019-064f7414b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b40ba-52de-4e8f-93ce-63fa2d7c02ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b40ba-52de-4e8f-93ce-63fa2d7c02ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdb7a46-9139-4ce5-8100-d3aa79e53ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f8f848885046198afe0ec21e9ad91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:08Z,use_quota=True,user_id='7123f144cce740e08496a74e5a09dbd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291a5e45-e33b-449f-a063-2e5072b6b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291a5e45-e33b-449f-a063-2e5072b6b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8531a3-7b83-4d8c-a5d5-e913e4a61cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8531a3-7b83-4d8c-a5d5-e913e4a61cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fdb7a46-9139-4ce5-8100-d3aa79e53ad7', 'volume_name': 'volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1476789-bb5c-4476-b253-f71f818959f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1476789-bb5c-4476-b253-f71f818959f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1602948-0e95-4440-a5d5-3249d1910bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:08 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Volume 3fdb7a46-9139-4ce5-8100-d3aa79e53ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7', 'volume_size': 1}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:08 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e 1073741824" returned: 0 in 0.742s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:08 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:08 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:08 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:08 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Flow 'volume_create_manager' (f0d6e2b4-667c-4440-b338-6d5cc0bf3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3a6266-4f83-4229-aafe-b769c7eb4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.534s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.470s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322833953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987a3aa-4219-4915-8c28-9f89f02d0faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:04Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume d987a3aa-4219-4915-8c28-9f89f02d0faa {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:09 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:09 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa 1073741824
Apr 24 01:21:09 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3a6266-4f83-4229-aafe-b769c7eb4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3c00a6-7f76-40d0-a803-460b79e02ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a359ad0de94d79a17484b63baf2571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:09Z,use_quota=True,user_id='0e0bcea37c704c3bbd9eda5ac38260e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a6ac1a-6253-4369-bf4f-20cfe96e59e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a6ac1a-6253-4369-bf4f-20cfe96e59e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4bf87e-6384-4b23-89b8-6324bb3011ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4bf87e-6384-4b23-89b8-6324bb3011ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db3c00a6-7f76-40d0-a803-460b79e02ffa', 'volume_name': 'volume-db3c00a6-7f76-40d0-a803-460b79e02ffa', 'volume_size': 1, 'snapshot_id': 'f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c0ab5-15f6-4bee-944d-bf60d691fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c0ab5-15f6-4bee-944d-bf60d691fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21edca2-08cd-4d3d-8e81-dfe261813548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Volume db3c00a6-7f76-40d0-a803-460b79e02ffa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db3c00a6-7f76-40d0-a803-460b79e02ffa', 'volume_size': 1, 'snapshot_id': 'f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0'}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf2795-d7e5-4e3f-97b4-79c20cdbf6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19415d8-5ec0-4f76-8da7-e406bd1ae3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:09 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Volume volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e (5e4c9bbc-c23b-40f9-bc28-716203695d0e): created successfully
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19415d8-5ec0-4f76-8da7-e406bd1ae3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (3ccb9931-5876-4cc4-b13c-7f4722f29c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:09 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-132b803b-c7c4-49c1-b2a7-d296eca13827 tempest-VolumeDependencyTests-1462755769 None] Created volume successfully.
Apr 24 01:21:09 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa 1073741824" returned: 0 in 0.690s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:09 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:09 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa
Apr 24 01:21:09 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (fa354527-2f14-4bf2-96be-e65894c3cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba22f58b-0f75-4c35-9dea-1cfda3c32f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba22f58b-0f75-4c35-9dea-1cfda3c32f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-212674401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd659350-ab14-402e-a9f4-33ae6f6fbba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7445451b21964357a15ac26633d137b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5e4c9bbc-c23b-40f9-bc28-716203695d0e,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:10Z,use_quota=True,user_id='6fd8f3c56e4444199a8d6143a822027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c83334-0442-4e55-9c59-5b9db8fcbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c83334-0442-4e55-9c59-5b9db8fcbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81459e2-ca33-4803-acc5-8a6e3aaceebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81459e2-ca33-4803-acc5-8a6e3aaceebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd659350-ab14-402e-a9f4-33ae6f6fbba6', 'volume_name': 'volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6', 'volume_size': 1, 'source_volid': '5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad420b2-19b7-4761-8528-a242d4d325c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad420b2-19b7-4761-8528-a242d4d325c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bb60d0-b9e0-4a59-8672-94d2f3dc8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Volume bd659350-ab14-402e-a9f4-33ae6f6fbba6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6', 'volume_size': 1, 'source_volid': '5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'source_volstatus': 'available'}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:10 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa" returned: 0 in 0.522s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.425s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136324904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0caae76-8ed4-464d-8e2f-48afc2c12519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume e0caae76-8ed4-464d-8e2f-48afc2c12519 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:10 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcfef5b-7d1d-43e6-a01c-90241729fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d987a3aa-4219-4915-8c28-9f89f02d0faa', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 1073741824
Apr 24 01:21:10 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70e5ed0-322d-462c-9206-22f061d00278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:10 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-d987a3aa-4219-4915-8c28-9f89f02d0faa (d987a3aa-4219-4915-8c28-9f89f02d0faa): created successfully
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70e5ed0-322d-462c-9206-22f061d00278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (3a81a091-53ca-4763-a146-83ec7265e9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:10 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-cc4b2a8d-500b-4004-a957-cdf7c5ffae69 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:21:10 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 1073741824" returned: 0 in 0.627s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:10 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:10 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519
Apr 24 01:21:10 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:11 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519" returned: 0 in 0.483s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.126s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69600922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b731ce0d-47ef-4c52-82ef-20f788284d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume b731ce0d-47ef-4c52-82ef-20f788284d19 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:11 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcbfd73-67cd-49f9-9aa0-7e75e4592534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0caae76-8ed4-464d-8e2f-48afc2c12519', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:11 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 1073741824
Apr 24 01:21:11 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320655b9-24c6-407a-b7c3-13bda2460160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:11 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 (e0caae76-8ed4-464d-8e2f-48afc2c12519): created successfully
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320655b9-24c6-407a-b7c3-13bda2460160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:11 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (b2d83d8f-8b3a-4609-bf78-4f043ea7c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:11 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-3cfe4776-3fbc-4881-9cb5-75f5bda80c41 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:21:12 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 1073741824" returned: 0 in 0.647s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:12 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19
Apr 24 01:21:12 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:12 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19" returned: 0 in 0.497s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.055s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480509787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae93ddb-e5cc-4901-a0ec-d915c7424f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume 5ae93ddb-e5cc-4901-a0ec-d915c7424f46 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:12 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5141135d-ea67-4d1d-854f-72d2858a6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b731ce0d-47ef-4c52-82ef-20f788284d19', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56bd354-b778-42d7-b778-9294f77d41f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:12 devstack sudo[91032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 1073741824
Apr 24 01:21:12 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:12 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-b731ce0d-47ef-4c52-82ef-20f788284d19 (b731ce0d-47ef-4c52-82ef-20f788284d19): created successfully
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56bd354-b778-42d7-b778-9294f77d41f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:12 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (16be7c4c-3db6-40f5-bfbb-29711b990502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:12 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-182e3a04-afb6-413f-925b-5161df077b15 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:21:13 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 1073741824" returned: 0 in 0.653s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:13 devstack sudo[91037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46
Apr 24 01:21:13 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:13 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" returned: 0 in 0.466s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.835s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841675276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa381862e748288336f4adc7fc4b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='8d1969097849469dbcbe58354b3dc814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Creating volume 1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:13 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18653d0a-bfe0-4d80-afbe-211e807aa242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:13 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 1073741824
Apr 24 01:21:13 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba256e40-9881-480a-8ce1-aff6f498a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:13 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 (5ae93ddb-e5cc-4901-a0ec-d915c7424f46): created successfully
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba256e40-9881-480a-8ce1-aff6f498a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:13 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (3d2619d2-9506-4770-b99f-4e32f60484dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:13 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-0b2109a3-6d48-4265-9ead-59238734c4f8 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:21:14 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 1073741824" returned: 0 in 0.717s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:14 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:14 devstack sudo[91045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3
Apr 24 01:21:14 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:15 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" returned: 0 in 0.453s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.823s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdb7a46-9139-4ce5-8100-d3aa79e53ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f8f848885046198afe0ec21e9ad91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:08Z,use_quota=True,user_id='7123f144cce740e08496a74e5a09dbd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Creating volume 3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:15 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bfc425-4dce-48f2-b86d-d11e6486e977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:15 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 1073741824
Apr 24 01:21:15 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f2db8e-5f35-47d1-9a9b-4a25c39976c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:15 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Volume volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 (1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3): created successfully
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f2db8e-5f35-47d1-9a9b-4a25c39976c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Flow 'volume_create_manager' (0375ec81-206b-4d05-ba03-ed0e88fd4d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:15 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-b5d1065c-ec04-4f98-a6d4-0014c75d97a7 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created volume successfully.
Apr 24 01:21:15 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 1073741824" returned: 0 in 0.641s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=156,cinder:SELECT=116,cinder:INSERT=38,cinder:DELETE=15 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:15 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7
Apr 24 01:21:15 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" acquired by "delete_volume" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113e838-7e90-4edb-ac3d-a6ee24599a37]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:15 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:15 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3
Apr 24 01:21:15 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:16 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" returned: 0 in 0.493s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.083s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-db3c00a6-7f76-40d0-a803-460b79e02ffa" by "_create_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1602948-0e95-4440-a5d5-3249d1910bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c8abfa-071d-43ee-87ba-280ed5cf7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-db3c00a6-7f76-40d0-a803-460b79e02ffa" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Creating volume db3c00a6-7f76-40d0-a803-460b79e02ffa from snapshot f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] snapshot: f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0, volume: db3c00a6-7f76-40d0-a803-460b79e02ffa,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:21:16 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Volume volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 (3fdb7a46-9139-4ce5-8100-d3aa79e53ad7): created successfully
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c8abfa-071d-43ee-87ba-280ed5cf7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Flow 'volume_create_manager' (db3e8d2c-1a78-4a58-8019-064f7414b549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:16 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-c827d8bc-eb7e-4953-bb69-9bccc49ed4a3 tempest-CinderUnicodeTest-720424919 None] Created volume successfully.
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d09fff6-bc1a-4bef-93f2-a02065fa5c88]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:16 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:16 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:16 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" returned: 0 in 0.636s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:16 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:16 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3
Apr 24 01:21:16 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81902) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 01:21:17 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Flow 'volume_create_manager' (063d4fb5-5a83-434b-85d3-a2c55f023f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02394b85-e7b8-4530-a50b-7762965bfb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:17 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.705s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" returned: 0 in 0.613s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3dd72c7-c061-49fb-b831-51de622540f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02394b85-e7b8-4530-a50b-7762965bfb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-140310432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb407d69-c30f-43e7-9ef0-2b9126c6c91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f8f848885046198afe0ec21e9ad91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:17Z,use_quota=True,user_id='7123f144cce740e08496a74e5a09dbd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30710355-c770-4d01-b0ea-1975473aa6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30710355-c770-4d01-b0ea-1975473aa6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889360fc-7db1-43cb-9894-e2ffffc669b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889360fc-7db1-43cb-9894-e2ffffc669b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb407d69-c30f-43e7-9ef0-2b9126c6c91d', 'volume_name': 'volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e4bd7f-d6ed-428d-95ad-cb4fba733c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e4bd7f-d6ed-428d-95ad-cb4fba733c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d435a2-defd-4d7a-8b2d-4bf495b893db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:17 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Volume fb407d69-c30f-43e7-9ef0-2b9126c6c91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d', 'volume_size': 1}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b4fd9e-bfaa-4a57-b047-4a670d771cd9]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3" released by "delete_volume" :: held 1.343s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['8c4f893e-b84d-4542-9cf6-a0fa6199a083', '0c15803b-ddbd-45f4-8240-6fdf6852eb9c', 'db07a6eb-e0be-46a9-b05f-4d40917e98a5', 'bb513598-a564-4186-8c34-445c4383ede9'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:17 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:17 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:17 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:17 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:17 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.469s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:17 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:17 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.616s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:17 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9e31cd9f-ee10-463c-b0b4-541755a32f0e tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-1c1c3b99-d2cc-40d1-bd63-78c340a3e9b3-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:17 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa
Apr 24 01:21:17 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-5ae93ddb-e5cc-4901-a0ec-d915c7424f46-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-5ae93ddb-e5cc-4901-a0ec-d915c7424f46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" acquired by "delete_volume" :: waited 0.024s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81be81a-ae93-4e8a-9721-33f9313de826]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:18 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:18 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46
Apr 24 01:21:18 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:19 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" returned: 0 in 0.938s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:19 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46
Apr 24 01:21:19 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_service.periodic_task [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81902) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:19 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:19 devstack sudo[91096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:19 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:20 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" returned: 0 in 1.314s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-5ae93ddb-e5cc-4901-a0ec-d915c7424f46" released by "delete_volume" :: held 2.339s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['b3ead9c8-fc25-4f01-a7c1-ea9135495cc9', '10d81312-cf85-40c9-a577-0dbcd13278d8', '4f05b0ae-0262-4997-91e6-28fc39cc7bbb', 'ee714725-3356-4873-8f3b-186cf95375a3'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:20 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.322s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-03295b01-f040-427e-9ca9-9b3542f71b64 None None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:20 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:20 devstack sudo[91100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:20 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-b731ce0d-47ef-4c52-82ef-20f788284d19-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-b731ce0d-47ef-4c52-82ef-20f788284d19-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-b731ce0d-47ef-4c52-82ef-20f788284d19" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:21 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-b731ce0d-47ef-4c52-82ef-20f788284d19" acquired by "delete_volume" :: waited 0.039s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:22 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca38fed3-77c9-478b-970b-d7641c501a20]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:22 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19
Apr 24 01:21:22 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:22 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:22 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:22 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:22 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:22 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-5d84289e-839f-4582-8734-8946a141884b tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-5ae93ddb-e5cc-4901-a0ec-d915c7424f46-delete_volume" released by "delete_volume" :: held 4.287s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:23 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19" returned: 0 in 1.091s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:23 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19
Apr 24 01:21:23 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:23 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa" returned: 0 in 5.438s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0b264b-fbe5-431b-aab0-2d4f7c65f5f6]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:23 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:23 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:23 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-b731ce0d-47ef-4c52-82ef-20f788284d19" returned: 0 in 0.529s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-b731ce0d-47ef-4c52-82ef-20f788284d19" released by "delete_volume" :: held 1.697s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['8c08a47a-3f75-4323-b8bc-502de39d2866', '5923d135-5bec-45b9-aa88-280ce420a70c', 'a6836103-1e5d-4a26-bf79-54d3cf7e361c', '39fa3fa3-3b87-4b18-8270-01d8b11391c7'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:23 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:23 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:23 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.719s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:21:23 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Converted 1024.00 MB image at 188.26 MB/s
Apr 24 01:21:23 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa is being set with open permissions: ugo+rw
Apr 24 01:21:23 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-e0caae76-8ed4-464d-8e2f-48afc2c12519-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:24 devstack sudo[91119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa
Apr 24 01:21:24 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-e0caae76-8ed4-464d-8e2f-48afc2c12519-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-e0caae76-8ed4-464d-8e2f-48afc2c12519" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-e0caae76-8ed4-464d-8e2f-48afc2c12519" acquired by "delete_volume" :: waited 0.015s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b5a17a-0577-4642-b611-5be0f883fa72]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:24 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519
Apr 24 01:21:24 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:24 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.541s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-d0129f3b-2819-4f30-8d37-63acb0561ee6 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-b731ce0d-47ef-4c52-82ef-20f788284d19-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:24 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa" returned: 0 in 0.560s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" released by "_copy_volume_from_snapshot" :: held 8.221s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-db3c00a6-7f76-40d0-a803-460b79e02ffa" released by "_create_volume_from_snapshot" :: held 8.267s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.316s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 14.444s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:24 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Cloning volume 5e4c9bbc-c23b-40f9-bc28-716203695d0e to volume bd659350-ab14-402e-a9f4-33ae6f6fbba6
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21edca2-08cd-4d3d-8e81-dfe261813548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3c00a6-7f76-40d0-a803-460b79e02ffa', 'volume_size': 1, 'snapshot_id': 'f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0381079a-d9ae-4e5e-a4fd-2fc47c434d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:24 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Volume volume-db3c00a6-7f76-40d0-a803-460b79e02ffa (db3c00a6-7f76-40d0-a803-460b79e02ffa): created successfully
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0381079a-d9ae-4e5e-a4fd-2fc47c434d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Flow 'volume_create_manager' (f0d6e2b4-667c-4440-b338-6d5cc0bf3566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Creating offline snapshot 5eb8d460-7fc5-44d7-ad49-fb300d2f9091 of volume 5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8d143-ab73-4aae-8dd5-664018cf31c8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:24 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-21ee12db-aad8-4103-aa12-75c3240bb41f tempest-SnapshotDependencyTests-802038019 None] Created volume successfully.
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=156,cinder:UPDATE=209,cinder:DELETE=24,cinder:INSERT=45 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:21:24 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519" returned: 0 in 0.610s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:24 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:24 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:24 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519
Apr 24 01:21:24 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:24 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:25 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e0caae76-8ed4-464d-8e2f-48afc2c12519" returned: 0 in 0.472s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-e0caae76-8ed4-464d-8e2f-48afc2c12519" released by "delete_volume" :: held 1.126s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:25 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:25 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 1G
Apr 24 01:21:25 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['bfb5e81b-77f2-467c-9634-7e7fea622b69', '9893bc67-31b8-4c39-add6-a4791cc5658b', 'e94f48ff-a86b-445c-bad0-f83988075171', '3d407d3b-ee8c-43ae-9b34-1e5a84c1fb9a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:25 devstack sudo[91138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:25 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Deleting offline snapshot f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 of volume e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] snapshot_file for this snap is: volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cdb8f4-5d0a-4ba2-959c-d2b0e6c4bb62]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:25 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:25 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:25 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.523s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:25 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:25 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 1G" returned: 0 in 0.689s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:25 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-22da3834-dde2-456a-a87c-a2cb6269fd21 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-e0caae76-8ed4-464d-8e2f-48afc2c12519-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:25 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:25 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:26 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.575s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3dd72c7-c061-49fb-b831-51de622540f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d68fc9-3dcb-4a7a-8688-6559ff51e402]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-d987a3aa-4219-4915-8c28-9f89f02d0faa-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-d987a3aa-4219-4915-8c28-9f89f02d0faa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:26 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:26 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-d987a3aa-4219-4915-8c28-9f89f02d0faa" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-d987a3aa-4219-4915-8c28-9f89f02d0faa" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a27c31-0911-485c-ac32-5eba515b32de]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:26 devstack sudo[91155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa
Apr 24 01:21:26 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:26 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.587s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:26 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 is being set with open permissions: ugo+rw
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:26 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:26 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:26 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.627s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:26 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:26 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:26 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa" returned: 0 in 0.629s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:27 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa
Apr 24 01:21:27 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.517s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:27 devstack sudo[91171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info
Apr 24 01:21:27 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.639s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:27 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0
Apr 24 01:21:27 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-d987a3aa-4219-4915-8c28-9f89f02d0faa" returned: 0 in 0.521s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-d987a3aa-4219-4915-8c28-9f89f02d0faa" released by "delete_volume" :: held 1.193s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['56c2539b-14d0-46f6-9cca-1c036b00b956', '068b548d-7d8c-4aa5-859e-12b95db9c097', '0f9bef96-00f1-4ddd-80a2-0c691fb655dc', '08274d6f-0b83-4796-a852-785db9d515f2'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:27 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info" returned: 0 in 0.551s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:27 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info is being set with open permissions: ugo+rw
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:27 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info
Apr 24 01:21:27 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:27 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:27 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:27 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:27 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1.f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" returned: 0 in 0.522s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0" released by "_delete_snapshot" :: held 2.477s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" released by "delete_snapshot" :: held 2.503s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Created reservations ['8ab5be3d-36a5-40d9-a987-ceaf512eec86', '39b517bc-3fc0-4bd6-b50e-c50158fd756e', '94d8dd53-f6a7-4efb-a4c0-eda2da9b4177', '20da89e5-df0b-47eb-87f6-f7bec2a4d170'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:28 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.info" returned: 0 in 0.485s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" by "_copy_volume_from_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] snapshot: 5eb8d460-7fc5-44d7-ad49-fb300d2f9091, volume: bd659350-ab14-402e-a9f4-33ae6f6fbba6,  {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb547f-a70d-4070-b866-5bb9ec42c71e]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:28 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.545s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:28 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Delete snapshot completed successfully.
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-87268d0a-c720-4ec0-86dc-95cb63602f89 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-f7fb8fbc-b4fd-441f-82fb-dfd1077cd1b0-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:28 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:28 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-e9a90d13-b3e2-4ee1-9d6f-1a497247311f tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-d987a3aa-4219-4915-8c28-9f89f02d0faa-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleting offline snapshot 258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 of volume c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] snapshot_file for this snap is: volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c79d76-091f-426d-a13c-5a2de481ef36]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:28 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958
Apr 24 01:21:28 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-e3dd72c7-c061-49fb-b831-51de622540f1-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-e3dd72c7-c061-49fb-b831-51de622540f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:28 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.612s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Creating direct copy from snapshot {{(pid=81902) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" acquired by "delete_volume" :: waited 0.025s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8fe74-86c0-4c6d-a1c4-26c69daa1596]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[0617b869-1baa-4010-aa7b-74f0b7cda569]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:28 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:28 devstack sudo[91194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:28 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:28 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:28 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:29 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" returned: 0 in 0.645s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e217ce-c638-4b38-8e77-2522e92a12db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f110312-3ec9-4c99-a441-4eca2d01d195]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:29 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db
Apr 24 01:21:29 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:29 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.573s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:29 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.606s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG cinder.utils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Path /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 not found in is_blk_device check {{(pid=81902) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:29 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1
Apr 24 01:21:29 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:29 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6
Apr 24 01:21:29 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:29 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db" returned: 0 in 0.603s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:29 devstack sudo[91219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958
Apr 24 01:21:29 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:29 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:29 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-e3dd72c7-c061-49fb-b831-51de622540f1" returned: 0 in 0.532s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-e3dd72c7-c061-49fb-b831-51de622540f1" released by "delete_volume" :: held 1.173s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Created reservations ['7f296647-6d02-48d9-bfba-9c28c824bcab', '84901da5-6e4d-46e3-92a2-097e6ff273ff', '1323f975-160e-4dff-9e39-d682135e1c9b', 'a80991ca-e0b0-4cb1-bb72-1438fdfadec5'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:30 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:30 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:30 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-db3c00a6-7f76-40d0-a803-460b79e02ffa-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-db3c00a6-7f76-40d0-a803-460b79e02ffa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" acquired by "delete_volume" :: waited 0.042s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:31 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" returned: 0 in 1.424s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea38a6-1b13-43d6-934a-a2902b6a7f37]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:31 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:31 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 1.180s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:31 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:31 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Deleted volume successfully.
Apr 24 01:21:31 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9dbaeb98-dc99-49e4-ab30-99efefd91a57 tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-e3dd72c7-c061-49fb-b831-51de622540f1-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:31 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa
Apr 24 01:21:31 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:32 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:32 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db.258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" returned: 0 in 1.108s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958" released by "_delete_snapshot" :: held 3.938s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" released by "delete_snapshot" :: held 3.966s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:32 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['8a17db00-2b21-487a-845b-b95a2f87bcd6', '88a4f0f3-7eeb-4578-8df0-6103f915b3c9', 'bf78df9c-13de-4a34-a186-ca25073ef03e', '5a8bba70-955b-4d74-97c6-da6abceec440'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:32 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Delete snapshot completed successfully.
Apr 24 01:21:32 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bb3d7edd-c1be-4a03-af44-5dc9e2bcd1a3 tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-258208a0-e0d6-4ff2-b5a8-7a0c4bccd958-delete_snapshot" released by "delete_snapshot" :: held 4.250s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-c7e217ce-c638-4b38-8e77-2522e92a12db-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-c7e217ce-c638-4b38-8e77-2522e92a12db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" acquired by "delete_volume" :: waited 0.032s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:33 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa" returned: 0 in 1.905s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab8e62-752f-4235-bc83-eac714c4e5f8]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:33 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:33 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa
Apr 24 01:21:33 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:33 devstack sudo[91245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db
Apr 24 01:21:33 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:34 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-db3c00a6-7f76-40d0-a803-460b79e02ffa" returned: 0 in 1.283s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-quobyte-db3c00a6-7f76-40d0-a803-460b79e02ffa" released by "delete_volume" :: held 3.324s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Created reservations ['437cb36b-14b8-45dd-b9c2-60d6d232f97a', 'ac67156f-a1e1-478c-a490-727e9b6fa1ef', '8fb32a66-4d00-4f9c-9a7f-47ceaaf9c1ab', '185fbc02-f838-4324-9e5c-3defb9c0b48e'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:34 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:34 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:34 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:35 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db" returned: 0 in 1.774s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:35 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db
Apr 24 01:21:35 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:35 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6" returned: 0 in 5.676s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[35131929-4d07-4622-a5b6-96a2c69d0634]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:35 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:35 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:35 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.609s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:35 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Deleted volume successfully.
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-97ab1698-500c-461c-b528-a7179f8fe2ff tempest-SnapshotDependencyTests-802038019 None] Lock "cinder-db3c00a6-7f76-40d0-a803-460b79e02ffa-delete_volume" released by "delete_volume" :: held 4.405s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:35 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-c7e217ce-c638-4b38-8e77-2522e92a12db" returned: 0 in 0.492s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-quobyte-c7e217ce-c638-4b38-8e77-2522e92a12db" released by "delete_volume" :: held 2.409s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Created reservations ['03beda3f-38d6-4e66-a9b3-984db466f895', 'a1761b7a-1763-490d-83e0-570b87834bb3', '96583e54-153e-4b11-885a-99d8a56a011e', '4118e40e-8502-4466-ac76-594cf7505ce1'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:35 devstack sudo[91262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:35 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:35 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.706s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG cinder.image.image_utils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 {{(pid=81902) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 01:21:35 devstack cinder-volume[81902]: INFO cinder.image.image_utils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Converted 1024.00 MB image at 180.36 MB/s
Apr 24 01:21:35 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 is being set with open permissions: ugo+rw
Apr 24 01:21:35 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:35 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6
Apr 24 01:21:35 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:36 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.474s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:36 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Deleted volume successfully.
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-23fcbda9-a552-4a45-88ec-6e1e696fd47d tempest-CreateVolumesFromSnapshotTest-297963774 None] Lock "cinder-c7e217ce-c638-4b38-8e77-2522e92a12db-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:36 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6" returned: 0 in 0.505s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" released by "_copy_volume_from_snapshot" :: held 8.238s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-5eb8d460-7fc5-44d7-ad49-fb300d2f9091" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-5eb8d460-7fc5-44d7-ad49-fb300d2f9091" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Deleting offline snapshot 5eb8d460-7fc5-44d7-ad49-fb300d2f9091 of volume 5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] snapshot_file for this snap is: volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[69148d3f-1d99-41d3-8b5c-957a1c3f216b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:36 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:36 devstack sudo[91269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:36 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:37 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.692s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[842dd472-831b-416b-a13b-19c83bf47f5d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:37 devstack sudo[91309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:37 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:37 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.650s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:37 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:37 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:37 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:38 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.685s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:38 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:38 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091
Apr 24 01:21:38 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:39 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e.5eb8d460-7fc5-44d7-ad49-fb300d2f9091" returned: 0 in 0.502s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-5eb8d460-7fc5-44d7-ad49-fb300d2f9091" released by "_delete_snapshot" :: held 2.636s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.553s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.946s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbf50ff9810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-23T23:21:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-140310432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb407d69-c30f-43e7-9ef0-2b9126c6c91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f8f848885046198afe0ec21e9ad91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:17Z,use_quota=True,user_id='7123f144cce740e08496a74e5a09dbd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eac78d1-159f-43e6-96a5-1295f087de3e),volume_type_id=5eac78d1-159f-43e6-96a5-1295f087de3e)}" {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Creating volume fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Selected osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054 as target Quobyte volume. {{(pid=81902) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 01:21:39 devstack cinder-volume[81902]: INFO cinder.volume.drivers.remotefs [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] casted to osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d 1073741824 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bb60d0-b9e0-4a59-8672-94d2f3dc8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6', 'volume_size': 1, 'source_volid': '5e4c9bbc-c23b-40f9-bc28-716203695d0e', 'source_volstatus': 'available'}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad46faa1-a204-4a65-8f3c-97c2ce3ca4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:39 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d 1073741824
Apr 24 01:21:39 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:39 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Volume volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 (bd659350-ab14-402e-a9f4-33ae6f6fbba6): created successfully
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad46faa1-a204-4a65-8f3c-97c2ce3ca4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Flow 'volume_create_manager' (fa354527-2f14-4bf2-96be-e65894c3cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:39 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bbc54954-4a1c-4357-b043-ad6aeaa1171d tempest-VolumeDependencyTests-1462755769 None] Created volume successfully.
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-5e4c9bbc-c23b-40f9-bc28-716203695d0e-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-5e4c9bbc-c23b-40f9-bc28-716203695d0e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-5e4c9bbc-c23b-40f9-bc28-716203695d0e" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-5e4c9bbc-c23b-40f9-bc28-716203695d0e" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a90889-3379-40ba-a2c2-81c8ea37ea8d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:39 devstack sudo[91330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:39 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:39 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d 1073741824" returned: 0 in 0.743s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:39 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:39 devstack sudo[91332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d
Apr 24 01:21:39 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:40 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.652s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:40 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e
Apr 24 01:21:40 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:40 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" returned: 0 in 0.514s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'} {{(pid=81902) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d435a2-defd-4d7a-8b2d-4bf495b893db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d', 'volume_size': 1}' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333fff21-00f5-4d46-b032-ce44e276c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 01:21:40 devstack cinder-volume[81902]: INFO cinder.volume.flows.manager.create_volume [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Volume volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d (fb407d69-c30f-43e7-9ef0-2b9126c6c91d): created successfully
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333fff21-00f5-4d46-b032-ce44e276c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81902) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Flow 'volume_create_manager' (063d4fb5-5a83-434b-85d3-a2c55f023f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81902) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 01:21:40 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-ddbef40d-2505-4875-9153-da3ef07d253b tempest-CinderUnicodeTest-720424919 None] Created volume successfully.
Apr 24 01:21:40 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-5e4c9bbc-c23b-40f9-bc28-716203695d0e" returned: 0 in 0.572s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:40 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-5e4c9bbc-c23b-40f9-bc28-716203695d0e" released by "delete_volume" :: held 1.289s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Created reservations ['67dc34a4-4f6c-4a8a-a9f7-0b7962ac57a4', '60dd2d31-2bb9-46f4-aec2-204317fbba1c', 'b88945a1-3dd0-447f-bb21-fbee732c066f', '427c32d0-d799-4cdf-b4b4-6e02bbaffe3d'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:41 devstack sudo[91341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:41 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:41 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.530s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:41 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Deleted volume successfully.
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Creating offline snapshot 85afe154-f6c6-4dce-add0-70f9e3069f64 of volume fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-a1cf929b-a871-4b78-9776-6cf8af0ea4b4 tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-5e4c9bbc-c23b-40f9-bc28-716203695d0e-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4535b8a-1508-444d-8998-927f13bf2028]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:41 devstack sudo[91345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d
Apr 24 01:21:41 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-bd659350-ab14-402e-a9f4-33ae6f6fbba6-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-bd659350-ab14-402e-a9f4-33ae6f6fbba6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" acquired by "delete_volume" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2209dab-1ed5-4a30-8031-ef250c641c00]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:41 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:42 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6
Apr 24 01:21:42 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:42 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" returned: 0 in 0.635s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 1G {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:42 devstack sudo[91352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 1G
Apr 24 01:21:42 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:42 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6" returned: 0 in 0.620s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:42 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:42 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6
Apr 24 01:21:42 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:43 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:43 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-bd659350-ab14-402e-a9f4-33ae6f6fbba6" returned: 0 in 0.542s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 1G" returned: 0 in 0.796s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-bd659350-ab14-402e-a9f4-33ae6f6fbba6" released by "delete_volume" :: held 1.215s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:43 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64
Apr 24 01:21:43 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Created reservations ['14dffb77-d0b3-4969-8c3f-1a1e0658d3fc', 'd3c87728-606a-4d29-a401-6ef6fd697579', '2c95f83c-5f17-4985-bfd6-1b83a15d869a', 'aeed212d-e49d-4bd8-a9c3-98df5010b509'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:43 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:43 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:43 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d -F qcow2 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64" returned: 0 in 0.607s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:43 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 is being set with open permissions: ugo+rw
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:43 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64
Apr 24 01:21:43 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:43 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.606s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:43 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Deleted volume successfully.
Apr 24 01:21:43 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-88bca7e3-7bcd-4b24-b5a4-9523f8b83ead tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-bd659350-ab14-402e-a9f4-33ae6f6fbba6-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-ea7c7778-310b-4dd2-ace3-f43e3a3bb347-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-ea7c7778-310b-4dd2-ace3-f43e3a3bb347-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" acquired by "delete_volume" :: waited 0.021s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d0ae9-6737-425e-b281-2d8674113d0d]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:44 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64" returned: 0 in 0.600s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:44 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347
Apr 24 01:21:44 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:44 devstack sudo[91377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info
Apr 24 01:21:44 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:44 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info" returned: 0 in 0.577s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:44 devstack cinder-volume[81902]: WARNING cinder.volume.drivers.remotefs [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info is being set with open permissions: ugo+rw
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:44 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info
Apr 24 01:21:44 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:44 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" returned: 0 in 0.693s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:44 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:44 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347
Apr 24 01:21:44 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:45 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" returned: 0 in 0.512s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-quobyte-ea7c7778-310b-4dd2-ace3-f43e3a3bb347" released by "delete_volume" :: held 1.259s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:45 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.info" returned: 0 in 0.606s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:45 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-a63316c4-19eb-47b5-86ca-da82191ca0fd tempest-CinderUnicodeTest-720424919 None] Create snapshot completed successfully
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Created reservations ['8b8fbc2b-0d18-4b0c-b332-49b773085f46', 'e67c2699-789f-4ffd-be3b-1f99fbdb03fe', '9e45a6e8-710c-4096-a00a-2ca7e4a5519d', 'a3e8214e-fa25-4b04-8833-72e9a6b7c71b'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:45 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:45 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-85afe154-f6c6-4dce-add0-70f9e3069f64-delete_snapshot" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-85afe154-f6c6-4dce-add0-70f9e3069f64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" by "delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-quobyte-85afe154-f6c6-4dce-add0-70f9e3069f64" by "_delete_snapshot" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-85afe154-f6c6-4dce-add0-70f9e3069f64" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Deleting offline snapshot 85afe154-f6c6-4dce-add0-70f9e3069f64 of volume fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] snapshot_file for this snap is: volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[94580586-c549-403b-bf7f-1d305454033b]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:45 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:46 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64
Apr 24 01:21:46 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:46 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.514s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:46 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Deleted volume successfully.
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-af8c9da4-71bf-41dc-9cce-469b1dd0959a tempest-VolumeDependencyTests-1462755769 None] Lock "cinder-ea7c7778-310b-4dd2-ace3-f43e3a3bb347-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:46 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64" returned: 0 in 0.645s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.remotefs [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81902) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ff947-4f77-4d86-914c-4e969f14c50f]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:46 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:46 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d
Apr 24 01:21:46 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:47 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" returned: 0 in 0.639s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:47 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64
Apr 24 01:21:47 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:47 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64" returned: 0 in 0.644s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:47 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:47 devstack sudo[91408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64
Apr 24 01:21:47 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:48 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:48 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d.85afe154-f6c6-4dce-add0-70f9e3069f64" returned: 0 in 0.449s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-85afe154-f6c6-4dce-add0-70f9e3069f64" released by "_delete_snapshot" :: held 2.496s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" released by "delete_snapshot" :: held 2.522s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:48 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Created reservations ['12a1243a-0c2f-4f03-8ba8-24b3cc1b3291', '6109ee9a-ae53-4c9e-81df-4bd48ec37f1a', '343da77c-6d93-43c2-999f-71b45a9ed664', 'd55a2f87-9481-449f-8d67-8f79201cccf8'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:48 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Delete snapshot completed successfully.
Apr 24 01:21:48 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-bd20417f-3d51-42ed-a42e-9adc0ce6063d tempest-CinderUnicodeTest-720424919 None] Lock "cinder-85afe154-f6c6-4dce-add0-70f9e3069f64-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-fb407d69-c30f-43e7-9ef0-2b9126c6c91d-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-fb407d69-c30f-43e7-9ef0-2b9126c6c91d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" acquired by "delete_volume" :: waited 0.017s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d155b-7ca3-47b2-9934-61d1962aab02]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:49 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d
Apr 24 01:21:49 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:49 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" returned: 0 in 0.520s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:49 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:49 devstack sudo[91418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d
Apr 24 01:21:49 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:50 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" returned: 0 in 0.458s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-fb407d69-c30f-43e7-9ef0-2b9126c6c91d" released by "delete_volume" :: held 1.038s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Created reservations ['6ea10d26-00fd-4344-8c0c-a90a815e1133', '3a436727-c91d-4f3f-8498-ab79c4a12f9c', '20ff9b96-8148-473d-bee5-aaecf697db05', '4c922cb1-a341-427a-819a-e88ed3b29467'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:50 devstack sudo[91421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:50 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:50 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.434s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:50 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Deleted volume successfully.
Apr 24 01:21:50 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-2df21179-d37d-4519-98b7-ab0e9a531d33 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-fb407d69-c30f-43e7-9ef0-2b9126c6c91d-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7-delete_volume" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "cinder-quobyte-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" by "delete_volume" {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" acquired by "delete_volume" :: waited 0.018s {{(pid=81902) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048f8b2-9221-4007-88d1-f93786637caa]: (4, 'qcow2') {{(pid=83038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:51 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7
Apr 24 01:21:51 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:51 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" returned: 0 in 0.537s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:51 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:51 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7
Apr 24 01:21:51 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:52 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028/volume-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" returned: 0 in 0.461s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-quobyte-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7" released by "delete_volume" :: held 1.038s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG cinder.quota [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Created reservations ['cb5f75a1-0b02-4d90-8f75-2430d3077541', '52e68f02-4700-4ebb-88b0-1acfe107b644', '43d045d7-40c5-445d-a16b-84a847bed608', '87815517-5bdc-4067-ba18-f73747e3059a'] {{(pid=81902) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054': None} {{(pid=81902) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6d47942-0a54-426a-a6df-3efd53e81054'] {{(pid=81902) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.lockutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81902) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028 {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 01:21:52 devstack sudo[91432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028
Apr 24 01:21:52 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 01:21:52 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG oslo_concurrency.processutils [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a178130991faf61f724a3c8757d4028" returned: 0 in 0.454s {{(pid=81902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 01:21:52 devstack cinder-volume[81902]: DEBUG cinder.manager [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Notifying Schedulers of capabilities ... {{(pid=81902) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 01:21:53 devstack cinder-volume[81902]: INFO cinder.volume.manager [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Deleted volume successfully.
Apr 24 01:21:53 devstack cinder-volume[81902]: DEBUG cinder.coordination [None req-9d7ae1f0-2727-4597-bd3e-6fa902b6ec93 tempest-CinderUnicodeTest-720424919 None] Lock "cinder-3fdb7a46-9139-4ce5-8100-d3aa79e53ad7-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=81902) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 01:22:06 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:UPDATE=152,cinder:SELECT=84,cinder:INSERT=35,cinder:DELETE=9 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 01:22:06 devstack cinder-volume[81902]: DEBUG dbcounter [-] [81902] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=81902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}